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MENTAL TESTS OF A GROUP OF EMPLOYED MEN 
SHOWING CORRELATIONS WITH ESTIMATES 
FURNISHED BY EMPLOYER 


By Jesse KNow.ton FLanpers, Oakland, Cal. 


This study is a unit of a larger problem in which the writer 
has interested himself. The object of the larger problem is to 
discover possible ways in which intelligence tests may be of 
service both to schoolmen and employers for the better place- 
ment in vocations of those who’are to do the world’s work. 
The Stanford-Binet Scale, which was used in the present in- 
vestigation, is the outgrowth of several years of painstaking 
effort by a number of psychologists in an attempt to perfect 
a means by which to measure native intelligence. Many of 
us believe that this has been a wise expenditure of time and 
effort. Nevertheless a large amount of careful work remains 
to be done, both in the improvement of current intelligence 
scales and in the determination of their practical value. The 
worth of the Binet scale, and of similar scales, has already 
been demonstrated in the care of various types of defectives 
and delinquents. It has also been shown that the scale can 
be made of invaluable assistance to the school-administrator 
in the better grouping of pupils according to ability, particu- 
larly in discovering the exceptionally gifted and the excep- 
tionally limited. When all due credit is given, however, to those 
who have done notable pioneer work along these and kindred 
lines, the fact remains that we are very much in the dark 
as to the extent to which, and the manner in which, intelli- 
gence tests may be of service in the solution of complex 
sociological. problems which hinge, in part, upon the native 
abilities of various social and occupational groups. In the 
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hope of establishing a wider field of service for intelligence 
testing, a series of studies was planned by the writer which 
would involve the testing of several groups of adults in various 
types of commercial and industrial lines, these groups to 
include individuals of every occupational status from those 
whose work is of non-skilled and routine character up to and 
including the professional classes. The main purpose through- 
out was to determine the degree of correlation between intelli- 
gence and success in the various vocations. It was hoped that 
the information to be gained would prove serviceable both for 
the vocational counselor in the school and for the employment 
manager in the industry. 

The study here reported is only a beginning. It was made 
possible through the courtesy and co-operation of the super- 
intendent of a large express company who provided a quiet 
room for the conducting of the tests and arranged to have his 
employees come there one at a time throughout the working 
day. Forty-seven were tested, most of whom were rated as 
clerks, although the group included a few drivers, collectors 
and loaders. The men were selected under the direction of 
the superintendent, the only restriction to his freedom of 
choice being that he should pick those concerning whom he 
would be able to give the desired additional information and 
that he should not pick anyone who had not been in the employ 
of the company for at least a year. This last restriction was 
violated in seven instances; three men had been with the 
company eleven months each, one for nine months, one for 
eight months, and two for six months each. By these restric- 
tions, however, the large class of “ floaters” was eliminated, 
as the median length of service was five years. It is believed 
that the group is fairly representative of that portion of the 
organization which was considered and of the men who may 
properly be regarded as permanent employees. 

The seven following qualities were chosen for comparison: 


Intelligence 

Accuracy 

Speed 

Co-operativeness in execution of work 
Loyalty to employer 

Dependability 

All-round efficiency 


Each man was classified independently by three of his su- 
periors in each of these qualities according as they regarded 
him as,—Very Superior, Superior, Average, Inferior, Very 
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| Inferior. These estimates were afterwards transformed into 

a numerical value on a scale from 5 to 1 and the three esti- 
mates combined to derive a final score. This made a possible 
variation in score from 15 to 3 in each quality. As a matter 
‘of fact, the variation was only from 15 to 8, due to the re- 
luctance of those estimating to classify any employee as either 
inferior or very inferior. This reluctance was probably justi- 
fied in view of the fact that these employees had survived the 
weeding-out process which had eliminated many “ unfit.” It 
served, however, to reduce the spread in the estimates and 
doubtless rendered the correlations somewhat less reliable than 
they would have been if definite instructions had been given 
for all of the men to be arranged in rank-order regarding 
> one particular quality, and this procedure repeated for each 
of the other qualities. Had this been done, there would have 
been a stronger incentive for those judging to compare each 
man very carefully with his associates and at the same time 
the offending terminology would have been avoided. The 
classification which was used has been repeatedly and suc- 
cessfully used with school children. The two situations, how- 
ever, are quite different. A school teacher has no reluctance 
in confidentially classifying as very inferior a pupil for whose 
presence in her classroom she is in no way responsible, while 
an employer regards it as a reflection upon himself to admit 
that he has retained the services of one who could be so classi- 
fied in any of these fundamentally desirable qualities. The 
information regarding the salary received by each man was 
furnished by the superintendent; the other information used 
in deriving the correlations of table No. 1 was obtained 
directly from the subject himself at the time of the testing. 

The correlations were found by the Pearson formula. The 
occupational status of the father was determined by Taussig’s 
classification. In computing the intelligence quotient the actual 
age above 16 years was disregarded. The range in actual 
age was from 55 to 19 with the median at 30. 

Most of the correlations are low. Perhaps the two most 
interesting findings of this study are, that intelligence, as 
measured by the test and expressed in I.Q., shows such a slight 
correlation with salary, and that the correlations between it 
and dependability and loyalty, while small, are actually nega- 
tive. It was thought that salary would be the best measure 
of all-round efficiency obtainable, and that efficiency would be 
largely determined by original endowment, chiefly by native 
intelligence. But it appears that there are factors more 
important than intelligence in the ultimate determination of 
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a man’s worth to his employer; at least, the man with the 
highest intelligence may not be the most desirable. In fact, 
we are led to believe that the men at the upper end of the 
scale in this group could be replaced by others with less intelli- 
gence without any sacrifice of efficiency. The same expendi- 
ture of money would thus secure men who would be more 
loyal and more contented. It should be kept in mind that the 
correlation between intelligence quotient and salary is of very 
little importance since the probable error for 47 cases and a 
correlation of .13 is .096. The range in mental age was from 
18 years and 7 months to 10 years, with a median at 15-2; 
the upper quartile was at 16-7 and the lower quartile at 13-9. 
(See table No. 2.) Evidently there is a great deal of intelli- 
gence going to waste, since the work that these men do is of 
a routine clerical nature calling for a high degree of accuracy 
but offering an exceedingly limited opportunity for the exer- 
cise of ingenuity or even personal judgment. Success is 
achieved by the faithful performance of an ordinary task for 
the doing of which perfectly definite rules have been given. 
The positions included are known by such names as Account- 
ing Clerk, C. O. D. Clerk, Settlement Clerk, Waybill Clerk, 
Clerk in Value Room, Clerk in On Hand Department, Clerk 
in Over and Short Department, Suspense Clerk, Receiving 
Clerk, Wagon Despatcher, Chief Router. These names indi- 
cate a high degree of specialization. The men in the group 
constitute the rank and file of an organization of 700 em- 
ployees, from which a small number of supervisors and semi- 
officials have been eliminated at one end and a large number 
of “floaters” at the other. They present the typical labor 
problems of this company. 

Why should men with a mental capacity which would 
enable them to acquire a college education be found doing 
work exactly similar in character to that which men can do 
who would never be able to complete in a satisfactory manner 
the eighth grade of our elementary school? It may be that 
they are lacking in emotional, moral or other necessary quali- 
ties; it may be that economic pressure crowded them out of 
the schools before they were able to prepare for more exacting 
service ; it may be that the schools did not provide them with 
proper training; it may be that they selected their vocation 
blindly and ignorantly. Whatever the reason, there is evi- 
dently a big social and economic loss. We have been told 
that there was no place in our present civilization for the 
man with eleven or twelve year intelligence. If the findings 
of this study are verified and are found to hold generally in 
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TABLE No. 2 
DISTRIBUTION OF GROUP BY MENTAL AGE 
Mental Age Number Mental Age Number 
9-7 to 10-6 1 14-7 to 15-6 1l 
10-7 “ 11-6 3 15-7 “ 16-6 8 
11-7 “ 12-6 0 16-7 “‘ 17-6 6 
12-7 “ 13-6 3 17-7 “ 18-6 5 
13-7 “ 14-6 9 18-7 “ 19-6 1 


other industrial lines, we shall need to concern ourselves more 
with the problem of providing a larger number of jobs suit- 
able for those who can score sixteen or seventeen years on 
the Stanford Revision, and with the further problem of mak- 
ing available the proper training for such jobs. We know 
there is a tendency in modern industry to develop what the 
men cynically call “ brainless systems,” where one mind fre- 
quently directs from 10 to 20 others with such minuteness 
that the other men closely approximate the moving part of a 
machine. In such a system the man with limited capacity 
has come into his own; he can render service to society where 
the more intelligent man would fail. It is conceivable that 
we may discover that one of the chief causes of the wide- 
spread labor unrest is due to workmen who chafe under a 
monotonous type of work because their active minds are not 
sufficiently occupied. We need to know the facts. 

Salary correlates most highly with accuracy and next with 
length of service. If a man does reasonably satisfactory work 
and remains with the company his salary is increased. One 
would like to have full information regarding those who have 
left the employ of the company over a period of years; both 
those who failed to make good and those who found the 
service irksome. Those who remained cannot be regarded as 
peculiarly adapted for just this kind of work since only three 
expressed unqualified satisfaction with their present position. 
These three had a mental age below the median for the group. 
Furthermore, there is no correlation between loyalty and 
length of service. 

We have been taught that additional schooling increases 
a man’s earning capacity; and on the whole that is doubtless 
true. We have here, however, a concrete case where school- 
ing seems to be of no importance whatever. The range in 
number of grades completed is from 13 to 3, with the median 
at 8. One man had finished a year at Annapolis; he was the 
only one who had gone beyond the high school. There were 
three others who had completed a high school course. Twenty- 
three of the group had at some time undertaken a course of 
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study to supplement their public school training, such as 
commercial school, correspondence school or evening school. 
Of these, 12 were above and 11 below the median in mental 
age; 3 were receiving the median salary, 10 were getting more 
and 10 were getting less. At the time of the interview there 
were only four who, in their leisure time, were pursuing a 
purposeful or systematic course of study in an effort to pre- 
pare themselves for a higher type of service. 

Three men had a definite ambition to reach a particular posi- 
tion within the organization ; 9 had the laudable but indefinite 
desire to “rise in the ranks;” 18 had ambitions the realiza- 
tion of which would have taken them outside of the organiza- 
tion; 17 would express no definite ambition of any sort and 
yet only three of them were satisfied. It is so much easier 
to know that we are dissatisfied with what we have than it 
is to know exactly what we want. As already stated, only 
four men were using their leisure time to help achieve their 
ambition. The most notable case is that of a man who 
wishes to become a Christian Science practitioner. The seri- 
ousness of his purpose is evidenced by the fact that, in order 
to prepare himself, he has been studying four hours a day 
for three years. He has a mental age which places him in 
the upper one-fourth of the group. As he never got beyond 
the first year in high school it is probable that he has a very 
meagre equipment of scientific knowledge. A similar case dis- 
covered by the writer in another study has caused him to won- 
der to what extent this condition, of high mental endowment 
and limited education, accounts for the growth of various 
pseudo-sciences. Is it not natural for the alert, active mind 
to demand some sort of problem to grapple with? Certainly 
we have no right to expect that the conclusions reached by 


TABLE No. 3 
INTERCORRELATIONS OF THE SEVEN QUALITIES AS ESTIMATED BY SUPERIORS 
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such minds shall always be sane and safe when the thinking 
has been done in entire ignorance of even the fundamental 
facts of the physical and biological sciences. This again 
emphasizes the fact that as a matter not only of conservation, 
but of self-defense as well, society cannot afford to continue 
to allow the highly gifted child to become submerged. We 
must discover him when he first enters school and see to it 
that regardless of the economic resources of his parents he 
is given a thorough education. 

Table No. 3 shows the correlations between the different 
qualities as estimated by the judges. It will be noted that 
these are all high. There is a strong tendency for these quali- 
ties to be found together. Speed shows the lowest correla- 
tions. It never exceeds .50, while each of the others corre- 
lates as high as .74 with at least one of the other qualities. 

The correlations between the estimates of one judge and 
those of another are given in table No. 4. On the whole they 
are fairly high, but since it is necessary, for the purpose of 
computing these, to divide the group into two smaller groups, 
because the same judges did not estimate all of the men, the 
P.E. is so large that care must be exercised in drawing con- 


TABLE NO. 4 
INTERCORRELATION IN THE ESTIMATES OF THE JUDGES FOR 19 OF THE MEN 
All- Intelli- Cooper- 
Accur- round _— Depend- ae 
Speed acy efficiency Rating ability ness Loyalty 
A&B... .80 .42 .33 18 51 —.28 —.22 
AGG... .62 .52 .27 58 .00 .28 —.36 
B&G... .50 .75 31 00 —.20 —.17 71 
INTERCORRELATION IN THE ESTIMATES OF THE JUDGES FOR 28 OF THE MEN 
D&E... .67 57 .40 .55 15 52 .33 
D&F... .52 .47 .29 .70 .16 41 50 
E&F... .46 .38 .38 a .39 .49 13 


clusions from them. _The closest agreement appears in speed 
and the least in loyalty. B and C have a very high correlation 
in their estimates of loyalty while each of them has a negative 
correlation with the estimates of A, which makes it evident 
that their standard was very different from his. If we com- 
bine their ratings and also those of D and F of the other 
group and then correlate the score thus obtained with 1.Q., 
the result is a correlation of —.39 instead of —.22 which had 
previously been obtained. The correlation between the esti- 
mates of A and the 1.Q.’s for the small group is only .10 which 
is of no significance since it is less than the P.E. 
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Before beginning the test the writer talked from five to 
ten minutes with each man, gaining his confidence, putting 
him at his ease and getting the information concerning par- 
entage, schooling, etc., which was used in making the corre- 
lations. In a number of cases an estimate was made during 
this talk of the man’s mental age. While most of these esti- 
mates were reasonably accurate, they were, in two instances, 
so wide of the mark as to confirm the writer in his conviction 
that he would make a poor disciple of Dr. Katherine Black- 
ford! 

Subject No. 47 is 24 years old and of Portugese parentage. 
He has a pleasing manner and good address and was esti- 
mated as having a mental age of 15. He reached the eighth 
grade after ten years of study but did not finish it. He was 
16 when he left. He began work with the express company 
as a wagon driver. In the eight years he has been with them 
he has held a dozen different positions and made a good record 
in every one. He is now Receiving Clerk at the company’s 
main depot. Packages are delivered to him for shipment to 
every part of the United States. He looks up the rate, proper 
routing, train connections, time required in transit, rules for 
crating, etc., whenever these are required by the shipper. He 
is exceedingly scrupulous about following directions and will 
never vary from them upon his own initiative. He is thor- 
oughly reliable. He has an ambition to become an agent in 
a small place and will doubtless receive such promotion in 
the near future. In the test, which occupied one hour and 
fifty-five minutes, he earned a mental age of 9-2. Four months 
later, at the request of the writer, he was given the same test 
by Dr. Kohs. On this retest, giving him the benefit of every 
possible doubt, he earned a mental age of 10-5. At the same 
time Dr. Kohs gave several performance tests which, while 
they have not been carefully standardized, gave added evi- 
dence that this man has a mental equipment not above that 
which is normal for an average ten-year-old boy. He is 
earning $90 a month and doing a type of work which makes 
him a very useful citizen. He illustrates the necessity for 
the distinction between intellectual feebleness and social feeble- 
ness which has been frequently pointed out by Dr. Terman. 
This man is definitely limited intellectually, but he can not 
be classed as feebleminded in any reasonable sense of that 
term. 

Subject No. 3 came to the test immediately after No. 47 
and was estimated as having a mental age not above 13; he 
earned one of 18-6. He was born in England, of English 
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parentage. He is 36 years old and has been in the United 
States four and a half years, having been with the express 
company all of that time. He is a helper to the C. O. D. 
Clerk and a very faithful employee. Previous to coming here 
he worked with his father, who is a grain merchant. He 
attended University College, London, for a year and refused 
to return because of a feeling of friendlessness. He had won 
first rank in a preliminary examination and if he had taken 
the major examination would very likely have won a scholar- 
ship that would have paid his expenses at either Oxford or 
Cambridge. As a boy he was extremely nervous; frequently 
got up at night to look for someone he believed to be in the 
room. His manner is retiring and unresponsive. There is 
very little expression in his face. He is very conscious of a 
speech impediment which, however, he has now quite largely 
outgrown. What a lot of needless suffering he would have 
been spared if he could have had, when young, the training 
which would have remedied this defect! Moreover, we can- 
not estimate the increase in value of his service to society 
which this might have meant; for it was precisely the con- 
sciousness of his defect that was the underlying cause of his 
feeling of ostracism while at school and which, directly or 
indirectly, has doubtless affected also his whole subsequent 
career. 

Brief mention will be made of two other cases. Subject 
No. 11, who is 55 years old, of Scotch-English parentage, 
earned a mental age of 16-11. He left school at the end of 
the 8th grade, has been with the company 34 years, and for 
the past five has been a Money Clerk. He is spoken of as 
being supersensitive, jealous and quarrelsome with his su- 
periors. He will probably never be promoted. Subject No. 
41 is 25 years old, American with English-German antecedents. 
He earned a mental age of 13-6; left school at the end of the 
4th grade and has done no additional studying since. He 
stated that he had an ambition to become a mail clerk, but 
was doing nothing definite towards achieving that end. He 
has been with the company five years. He has received an 
increase in salary of $20 per month in less than a year and 
is being considered at the present time for further promotion. 
He was referred to as one of the most promising of the group. 
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VARIABILITY OF THE EDUCATION OF 
UNEMPLOYED MEN?’ 


Hersert A. Toops and Rupotr Pintner, Ohio State University 


During the past two years the writers have collected a large 
amount of data in regard to the final educational attainments 
of unemployed men. From these data has been derived evi- 
dence to point to the probability that education, wages, and 
industrial success are in large degree dependent upon the 
intellectual ability of the men. With the records at hand 
and a knowledge of the changing conditions in industry dur- 
ing the two years, it is now desirable to investigate the relation 
of education to the type of men applying at any particular 
time or season, and under different industrial conditions,—in 
brief, the changes in the educational] attainments that may be 
noticed in an employment office over a period of time. 

This report deals with the results obtained from the records 
of the applicants for positions at the Dayton, Ohio, Free 
Employment Office during the years 1916 and 1917, giving a 
more complete analysis of the results for the latter year. A 
tabulation by grades and by months was made of the “ grade 
at leaving school,” as reported on the registration cards of the 
7,020 newly registering applicants who reported this item in 
1916, and of the 9,506 new applicants who reported the item 
satisfactorily in 1917. 

We at first wish to know whether the educational attain- 
ments of the applicants as a whole have changed during the 
period under consideration. If we make the assumption, 
merely to have some substantial basis upon which to make 
our calculations, that a grade “8” as reported means eight 
grades completed, then the median grade at leaving school 
will probably best give the desired information, We also 
wish to know whether there has been any change on the whole 
in the type of men as to education, whether more or fewer 
men of high and low educational attainments respectively 
applied in the one year than in the other, and finally, if any 





1 The writers wish to acknowledge their indebtedness to Mr. Eugene 
A. Mead, Superintendent of the Dayton State-City Free Employment 
Office, without whose cooperation and encouragement this report would 
not have been possible. 
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change is noted, we wish to know more about the changes 
and the men causing the changes. 

Table I shows the number of men reported upon by months 
and the median educational attainments of the applicants by 
months for the two years. 

We note that, in spite of the fact that the total number of 
reporting applicants increased by about 26 per cent in the 
second year and that for particular months the percentage of 
applicants in 1917 was about twice that of 1916 due to unusual 
industrial conditions, the median attainment in education for 
the two years is almost the same, 8.30 grades of school com- 
pleted by the 1917 applicants. as compared with 8.28 grades 
by the 1916 applicants. If we consider the monthly medians, 
we note but little change in these also. Even the greatest 
of the differences could be produced by the shifting of about 
a dozen men from one extreme of the distribution to the other. 
Such stability of the central tendency is characteristic only 
of distributions which have a very fundamental property of 
humanity as an underlying basis. About all that one can say 
of the slight amount of variation which is probably significant, 
is that in general the medians are lower in the winter and 
spring months and higher in the summer and autumn months 
than the average grade for the entire year. During the sum- 
mer and autumn months of 1916 the office placed many skilled 
mechanics in positions in munition factories and also many 
mechanics who were out of jobs because of a strike; yet the 
large number of these presumably better educated men did 
not raise the median of the group to any appreciable extent. 
In the summer of 1917 the office was called upon to supply 
many men, of whom many were skilled, to the aviation con- 
struction camps and to the army cantonment construction 
camps; and again the monthly medians are not affected to 
any great extent. Then in the fall months of 1917, a change 
in the attitude of employers towards the office was effected. 
The office had proved itself so efficient in securing good men 
during the summer months that the large manufacturers of 
the city mutually agreed to stop all advertising for em- 
ployees and rely entirely upon this office for their new em- 
ployees. Yet in the fall and winter months of 1917 we note 
but little change in the monthly median attainments although 
the median does seem to be on the upward trend. The policy 
of this office has been in the past to discourage the applications 
of undesirable men and to encourage the applications of high- 
grade men. Why, then, with the large increase in number 
of high grade men that is known to exist in 1917, do not 
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the median educational attainments of the group change more 
appreciably ? 

To answer this question it is necessary to study intensively 
the distributions of the men by the grades at which they left 
school and by the different months of the year. We must 
determine the changes that have gone on from month to month 
and note whether there is an increase or decrease of poor, 
fair and well educated men as time goes on. An examination 
of the crude number distributions by grade and by month of 
registration can give us no clue to the information which we 
are seeking. Such a distribution table is too lengthy to be 
given here. It is readily apparent that the crude numbers 
can have no value for us unless taken in connection with the 
total number of applicants during a given period of time under 
consideration. To illustrate: If the number of applicants 
who had a second grade education and who registered and 
reported their education during May was twice as great as 
the number with second grade education who registered in 
April, but the total number of applicants in May was only 
half of the number registering in April,—then the relative 
increase of the number with a second grade education in May 
over the number gwith second grade education in April is 
300 per cent, and not 100 per cent as given by the crude 
numbers; or, the ratio we desire is four and not two. We 
can then say that the number of second grade applicants has 
relatively increased to four times the number in April. The 
ratio desired for our comparisons, then, amounts to dividing 
the number of applicants in a given month with a given amount 
of education by the corresponding number which is to be 
expected in that month when the total increase of that month 
over the preceding month is taken into account. It can be 
easily shown that what this amounts to mathematically is 
dividing the per cent with the given grade of education at 
the particular month under consideration by the percentage at 
the same grade for the preceding month or for the time period 
with which it is to be compared. 


If, NJ?=the total number of reporting applicants in January, 
NF+$the total number of reporting applicants in February, 
nJ=the number of second grade applicants in January, 
nF=the number of second grade applicants in February, 

then the number of second grade applicants in February, if there 
were no relative increase or decrease of second grade applicants, who 





2 The italicized letters indicate modifiers, not algebraic factors. 
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are expected by reason of the change in the total number of applicants 
in the two months, is 


NF 
NJ 


EF 





nj 


But usually nF is not equal to EF (the number to be expected) for the 
reason that there is some relative change in the numbers in the two 
months. Our ratio, or index of comparison of the number of second 
grade applicants in February with respect to January, then, is, 


nF 
I , 
EF 
nF nF NJ 
ae = ——. 
NF NF nJ 
NJ 





or, 





We may write this expression in the following form, 
nF nj 


~~ eae 





The index of comparison of the number of second grade applicants 
in February to the number of second grade applicants in January is 
thus the quotient obtained by dividing the per cent of such applica- 
tions in February by the corresponding per cent in January. 

When this index is 1.0, there is no relative change; when the index 
is less than 1.0, there has been a relative decrease, and when the index 
is greater than 1.0 there has been a relative increase of second grade 
applicants in the second month with respect to the first. An index of 
1.20 in the above case would mean that the second grade applicants 
in February had relatively increased 20 per cent over the number of 
such applicants in January. 

We have then but to reduce the grade distributions to percentages 
and divide the percentage in the second period at any given time period 
by the percentage in the same grade at any preceding period with which 
we wish to compare it. The index has the value, which a com- 
parison directly of the crude percentages has not, that equal gross 
differences, say at the first and eighth grades, are shown in their 
true perspective as regards the per cent of relative change. One 
per cent of gross difference in the first grade is a much greater 
relative change than one per cent gross change at the eighth grade, 
because the actual percentage upon which the relative change is based 
is much larger in the eighth grade than in the first grade. 


If we reduce our distribution table of percentages to these 
index numbers, we get a result that is almost as bewildering 
as at first, so far as being able to usderstand the changes that 
have taken place in the composition of the group. Accidental 
or chance changes in the gross numbers by months and by 
grades play a large part in the determination of the index 
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numbers. We have made the meaning of the changes more 
readily apparent by the following procedure. The table of 
distributions was regrouped by adding together several grades 
of low frequencies and then grouping these frequencies into 
still new groups on the basis of the seasons of the year. By 
this procedure, accidental changes in the distributions are so 
averaged that their effect is practically negligible. These fre- 
quencies, both in numbers and per cents are shown in Table 
II. The upward trend during the year is then clearly apparent 
by the medians alone. 

If we take the percentage frequencies of the winter months, 
January and February together, to represent the conditions 
at the beginning of the year and compare all the other per- 
centage frequencies with these, by the method above described, 
we get the indices of Table III. Since these indices may be 
taken to represent the relative percentages which each period 
is of the conditions prevailing at the beginning of the year, 
we have but to subtract 1.00 from each index to get the per 
cent of relative increase in a particular group of grades 
throughout the year (Table IV). Thus, if we subtract 1.00 
from the index for the summer months (June, July, August) 
in the eighth grade, we find that the eighth grade applicants 
in the summer months have relatively increased by 3 per cent 
over the eighth grade applicants in the winter months of Janu- 
ary and February together. A negative percentage in the 
table means a decrease. 

Now let us see how these last two tables help us to under- 
stand the relation of education to the kind of applicants apply- 
ing at different times and under different industrial condi- 
tions. We at once note from Table IV the relative decrease 
throughout the year of all men with education less than an 
eighth grade education, as is shown by the negative signs. 
The eighth grade and I-year high school men are rapidly 
increasing in relative importance. From Table III we note 
that, for the whole year, the 7-grade men and the II, III and 
IV-year high school men together have made but little change 
while there have been large gains made in the relative percen- 
tages of the eighth grade and I-year high school men and 
College Men (A, B, C, D, E). The two most significant 
relative increases are in (1) the eighth grade, which has the 
largest gross total of applicants of any grade and in which 
small relative changes mean large changes in gross numbers 
and (2) in the I-year high school. The relative increase in 
the College applicants is not so important for the reason that 
the group has a rather small gross number in it. We also 
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note that the rate of relative decrease of the lower grade men 
is seen to slow up with the approach of the winter months. 
We may derive several conclusions from the above figures. 
With the changing of the attitude and policy toward the office 
and the calls made upon it to send out skilled workers in 
larger and larger numbers, we note that there is a decided 
increase in the relative proportion of eighth grade and I-year 
high school men, a fact which means that there is a relatively 
large gross number of these men applying at the end of the 
year as compared with the beginning of the year. To make 
up for the increase in these two grades we have then con- 
sistent decreases in the relative importance of the men of 
lower grades, the largest relative decreases being in the case 
of the men with least education. What that means from an 
industrial standpoint, since the number of men actually hired 
by employers bears a rather constant relation to the type of 
applicants, is that where given the chance to choose their 
employees from men of all degrees of education, employers 
are choosing their men with the better education wherever 
possible. If we regard the number of men in the lowest grade 
group (no school, first and second grades) in Table II we note 
that the gross numbers of these poorly educated men decrease 
but little, although they show a tendency to increase with the 
approach of winter or at least to decrease at a slower rate 
than in the summer months. What this probably means is 
that the places which they might have held in the industrial 
world are being taken by better educated men, and that they 
still keep on applying at the office for work, since their num- 
ber does not decrease to any great extent although their rela- 
tive importance is decreasing. The men with little education 
are thus a rather stationary class. We have good reason 
to believe that these are often men who are mentally incom- 
petent, and that whatever makes for mental inefficiency makes 
also for educational and industrial inefficiency. Consequently 
these men are last to be hired and first to be thrown out of 
jobs when the employer has the choice between poorly edu- 
cated men and the better educated men. The choice exercised 
by the employer is not made because of the poor education 
but because of industrial inefficiency. Indeed, the test admin- 
istered by the employer is not the amount of education of the 
applicant but an industrial test——whether or not the applicant 
is able to do the work for which he is to be hired. Lack of 
education and industrial inefficiency are thus probably both a 
result of poor intellectual endowment. That the men of poor 
education are relatively more numerous in the winter than 
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in the other seasons is no doubt due to the fact that such 
men, when employed, work at such work as can be carried 
on during the spring, summer and autumn months only. In- 
dustry, too, is usually more active during these periods so that 
there would be a greater chance for some of them who had 
rather a poor education but a fair amount of intellectual endow- 
ment to obtain jobs in competition with men who are better 
endowed intellectually and are generally better educated. It 
is not, of course, maintained that poor education is always 
found only among poor or undesirable workers, but in general 
this would seem to be true. 

The lower grade men are decreasing in relative importance 
but not greatly in actual numbers. The eighth grade and 
I-year high school men, i.e., those around the median educa- 
tional attainment, have increased both in numbers and rela- 
tive importance. There is a decrease in the relative importance 
of the men of the last three high school grades with but little 
change in the absolute numbers. These three facts then are 
sufficient to explain why the median attainment has changed 
so slightly. The median deviation of the 1917 distribution 
is less than that of the 1916 distribution ; the cases are grouped 
more densely about the median. The men from the last three 
high school grades, while being perhaps even more desirable 
employees, are few in number in the community and so cannot 
change the median attainment to any very great extent even 
if all were included. Of the few who are in the community, 
most of them are probably permanently employed and so 
do not have occasion to come to the employment office. Con- 
sequently then, if all employers of the city were to demand 
only better educated men, they would have to recruit most 
of them from the seventh, eighth and I-year high school men. 

Such distributions point to a very fundamental principle 
underlying not only education but industry as well. All 
people of a population (industrial workers and otherwise) 
have varying intellectual endowments, which are distributed 
according to a curve of normal distribution, and which influ- 
ence the industrial success and school attainments of the popu- 
lation to just about that degree in which the respective degrees 
or measures of mental endowment are found to occur.’ Since, 
considering all the working population, the frequencies of these 
degrees of mental endowment do not change, i.e., are heredi- 





8 Pintner, R. and Toops, H. A.—Mental Tests of Unemployed Men. 
Journal of Applied Psychology, Vol. I, No. 4, 1917, pp. 325-341. 

And also, by the same authors, Mentality In Its Relation to Elimin- 
ation from School. School and Society. To appear shortly. 
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tary and hence change very slowly, if at all, in the general 
population,—we should expect the median amount of educa- 
tion at any time to approach to a constant value; and we 
should expect the education of any industrial group to be made 
up of different proportions of men of the respective amounts 
of education according to the amount of competition for posi- 
tions, and the possibilities of employers choosing their men 
from all possible grades of men. The employers choose, 
whenever possible, the better educated men not because of 
their better education primarily, but because of their better 
intellectual endowments which enable them to make better ad- 
justments to their work. This, in turn, makes them more 
satisfactory employees. 








AN EXPERIMENT IN INFANT EDUCATION 


INTRODUCTORY STATEMENT 
By Lewis M. Terman, Stanford University 


The following article was written at my urgent request by 
the father of Martha. The statements it contains border so 
closely on the incredible that I have thought best to state here 
briefly what I know about the child. 

Martha lives within a few miles of Stanford University. 
Her father is a lawyer, having graduated from Stanford 
University at the age of 21 years. The mother was a teacher 
before marriage. I first saw Martha on the evening of 
March 31, 1918. At that time she was a few days more than 
26 months old. Several times I had heard of her as a child 
prodigy who was able to read like a school child. On the day 
just mentioned Martha’s father brought her to my home and 
allowed me to observe her reading ability. Her performance 
was quite beyond anything I had deemed possible for a child 
a little more than two years old. She read from any primer 
fluently and with better expression than most first grade chil- 
dren are capable of. Her pronunciation, however, was babyish 
as one would expect in the case of a child who had only talked 
one year. Given primers which she had never seen, she read 
from any starting point without hesitation. Whenever she 
came to a word she did not know she said, “ What’s that?” 
In one little lesson she was given to read, four new words 
were encountered and pronounced for her. An hour later 
she was able to recognize all of these even when they were 
shown to her in word lists at the back of the book. I did 
not undertake to measure her reading vocabulary, but from 
what I heard of her reading I am convinced that it is larger 
than that of the average child who has spent ten months in 
the first grade. 

I have known Martha’s father for approximately three 
years and I wish to say that his statements in the following 
article should be accepted without the slightest discount for 
paternal pride or faults of observation. He has made the 
article a plain statement of fact, leaving each reader to inter- 
pret the interesting phenomenon according to his own theories. 

One other pertinent fact should be mentioned: Martha’s 
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oldest brother, 11 years old at this writing, has the highest 
intelligence quotient I have found among California children. 
At nine years he tested 171, and a year later 172. At 11 
years he is leading his class in the eighth grade. This boy 
was given a course in intensive mind culture similar to that 
employed in the case of Martha, only not so early in life. 
In his fourth year he could read various primers and at the 
age of six he devoured books which are ordinarily not read 
by children below the fourth grade. There is one other child 
in the family, a boy two years younger than John. This boy 
is making an average record in the third grade and seems to 
be little if any more advanced in intelligence than the average 
child of his age. This boy enjoyed no special instruction like 
that given the other two children for the reason that the 
father at that time was fully occupied by professional duties. 

It is interesting to conjecture to what extent the precocity 
of John and Martha was due to the educational stimulation 
they received, and to what extent the average condition of 
the other child is the result of the omission of: such stimula- 
tion. The question can here only be raised; but it is within 
the possibilities of psychology to find, by properly controlled 
experiments, an answer to this and similar questions relating 
to the plasticity of the human intellect. Is it too much to hope 
that the experimental psychology of the future will concern 
itself more with the dynamics of mind and character than it 
has in the past? 


By MartuHa’s FATHER 


Up to the age of nineteen months my daughter, Martha S., 
was apparently a normal child mentally and physically. She 
began to talk and to walk at the usual age and her progress 
in these particulars was neither more rapid nor slower than 
that of the average child. 

At the age of about fourteen months she had acquired 
the use of her first three words, “mamma,” “ papa,” and 
“pretty.” I then began an experiment in child education 
which has continued, more or less intermittently, up to the 
present time. I had heard of certain infants who showed great 
precocity at early ages, and was moved by curiosity to attempt 
to discover, for myself whether such children are specially 
gifted by nature with unusual mental powers or whether the 
same development might not be attained by any normal child 
such as Martha appeared to be. 

I had no access to any of the literature on the subject, and, 
indeed, up to the present time have not read any book or 
article dealing with cases of early mental development and 
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lt the methods employed to secure it; nor have I ever been a 

teacher or particularly interested in educational matters. The 
results obtained, therefore, have naturally been limited by the 
fact that I was a rank layman pioneering in a field to me 
unknown, without knowledge of educational methods and 
compelled to rely upon such crude expedients, in lieu of 
methods, as might suggest themselves to a lay mind. In 
view of the measure of success which has attended an experi- 
ment undertaken under such obvious disadvantages, it is safe 
to assume that had the same experiment been carried out con- 
sistently and uninterruptedly by a qualified educator, the 
success would have been proportionately greater. 

As an initial step 1 cut from red cardboard a number of 
large capital letters and tacked them on the living room wall 
among the various pictures hanging there. In moments of 

leisure 1 took Martha in my arms and walked from picture 
to picture naming the objects represented. Occasionally I 
stopped before one of the letters and said “See pretty B,” 
“ There is O,” or “See M,” as the case might be. In a few 
days she was able to recognize B, and her fourth spoken word 
was “pretty B.” At this time she learned to recognize three 
or four of the capital letters; but her progress was slow and 
disheartening, and as spring work on the ranch was coming 
on, I dropped the experiment altogether. From that time for 
about five months no special effort was made to direct her 
mental development, which proceeded normally. I did, how- 
ever, in spare moments make it a practice to point out various 
objects and to pronounce their names slowly and distinctly, 
with the result that her vocabulary of nouns was rapidly 
increased. 

One day when she was about nineteen months old her aunt 
showed her the pictures in a nursery book, in which she at 
once became greatly interested, and from that time her mental 
development has been rapid. While it is doubtless unsafe 
to generalize from the results of a single experiment of this 
kind, my experience with Martha leads me to believe that the 
secret of unlocking the wonderful powers of the baby mind 
lies in securing its interested attention to matters of educa- 
tional value, and that by far the most effective means of arous- 
ing such interested attention is the nursery picture book, 
properly employed. 

I placed in her hands a book which, in addition to a number 
of pictures interesting to the child mind, contained capital 
letters in flaring type and colors. She at once became inter- 
ested in the pictures and fell into the habit of rushing to 





222 TERMAN 


me, whenever I entered the house, to have me show them to 
her. At these times I took her on my lap, turned to a picture, 
told her what the objects represented were, and chatted about 
them in such fashion as seemed most to arouse her interest. 
Occasionally I turned suddenly to the pages of capital letters, 
pointed to one of them, and exclaimed with feigned excite- 
ment, “ Oh Martha! Look! Look! There’s P!” Then, with- 
out giving her time to discover the deceit and to determine 
for herself that after all there is nothing wildly exciting 
about the letter P, I returned to the pictures and excited her 
interest in the vicissitudes of Tom the Piper’s son, only to 
turn back after a few moments and point with an exclama- 
tion to another letter. The pictures were unquestionably of 
great interest to her, and as the references to the uninteresting 
capitals were only occasional and momentary, the net result 
of these sessions was that she found the book as a whole a 
great joy, failed to discover the camouflage in the matter of 
the letters, and nevertheless became familiar with them. When 
she was nineteen months and thirteen days old she was able 
to recognize and pronounce all of the capital letters. 
Although I am informed that the method of teaching a 
child to read by first teaching it its letters is decidedly out 
of vogue, I nevertheless continued in that error, if error it 
be, and next proceeded to teach Martha the small letters. As 
I had no picture book containing the small letters in showy 
type, I was compelled to_-resort to another expedient. I drew 
the letters carefully on the back of business cards, and kept 
a few of these in my pocket. When she grew tired of looking 
at pictures I allowed her to play with these cards, of course 
calling her attention from time to time to the letter on the 
back of each. She became interested about this time in explor- 
ing my coat pockets and pulling the contents out of them, so 
I sometimes placed a few cards in a pocket open to attack, 
and allowed her to pull them out one at a time, refusing to 
let her have a new card until she pronounced the letter on 
the one already pulled out. As this refusal constituted an 
obstacle to an interesting investigation, she sensibly surmounted 
it by observing the letters and pronouncing them in order to 
experience the joy of delving into the depths of the pocket 
for a new card. At other times I varied the play by sitting 
down with a pack of the cards in my hand and giving them 
to her one at a time to be carried by her across the room 
and delivered to her mother or aunt, refusing to gtve her 
another until she told mother or aunt the name of the letter 
on each card delivered. Both mother and aunt always dis- 




















AN EXPERIMENT IN INFANT EDUCATION 223 


played a highly gratifying interest and astonishment at all 
information so volunteered by her, and she doubtless felt that 
she was playing a very important role in an extremely impor- 
tant matter. At any rate she enjoyed the process immensely 
and incidentally learned her small letters. 

When she was twenty months old she knew both small and 
capital letters thoroughly, and I next proceeded to teach her 
to read. For the initial steps the picture books were again 
resorted to. In passing from picture to picture I occasionally 
dropped down to the reading matter, placed my finger under 
the word “ the,” and said in a casual manner, “And there is 
‘the,’ Martha,” proceeding instantly to another picture before 
that wholly uninteresting image of a word could detract 
from the vivid interest aroused by the pictures. In a few 
days she knew “the” and had no difficulty in picking it out 
herself in a page of print. Several other words, such as 
“book,” “man,” “ fat,” “boy,” and “ girl,” were taught in 
the same way. These words were then transferred to the 
backs of cards and thoroughly fixed in her memory by follow- 
ing out the series of plays used in teaching the small letters. 

As I felt that the type in ordinary primers would be too 
small for a child of her age, and as an examination of a 
number of these primers indicated that much of the matter 
related to things beyond her knowledge, I determined to pre- 
pare my own primer. I accordingly purchased an ordinary 
five cent composition book, cut highly colored pictures from 
magazine advertisements, pasted them in the book, and printed 
under them simple words referring to the pictures in letters 
half an inch high. 

Her interest in this book was confined almost exclusively 
to the pictures, the reading matter in itself making no special 
appeal to her. She wanted to see the pictures; before a page 
was turned and a new picture brought to view it was necessary 
to pronounce the words, and she did so as a means to getting 
to something enjoyable. Of course new words were gradually 
added on succeeding pages. Although the words were arranged 
in short sentences she did not at first realize any connection 
between the words or grasp the idea that these words as 
combined expressed a thought. Each word was for her a 
picture without relation to other pictures. When she was 
twenty-one months and ten days old the idea that these word 
pictures represented thoughts sudenly dawned upon her while 
pronouncing the words “I see mamma” written under a 
photograph of her mother. This discovery was attended by 
every indication of mental pleasure, and from that moment 
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she began to read in the true sense of the word. I find from 
my records that on that day she had a reading vocabulary of 
thirty-five words and could distinguish between and name the 
primary colors. 

It may be observed that up to this time the process of 
teaching was one of indirection. No effort was made to 
interest her directly in characters or words to be memorized. 
These were, on the contrary, studiously kept in the background, 
and her attention was directed to them only casually and 
momentarily from time to time in connection with pictures 
or matters which aroused and held her interest. In a world 
overflowing with things interesting to the baby mind it is 
a difficult task to secure direct concentration on such uninter- 
esting things as letters and word pictures. 

The difficulty of securing such direct interest in reading 
matter now began to manifest itself. With each additional 
lesson added to the home-made primer the number of words 
in proportion to pictures increased, and Martha’s interest 
began to decrease in much the same proportion. The reading 
matter was assuming a prominence which no longer made 
it incidental to the pictures, but which threatened to make 
the pictures incidental to it; and as she had not reached the 
stage where the act of reading in itself afforded pleasure, she 
began to get suspicious of a book in which interesting pic- 
tures appeared only between arid stretches of word pictures. 
It was now necessary to bridge the difficult gap between this 
point and the point at which the act of reading would begin 
to be a pleasure by reason, not of the accompanying pictures, 
but by reason of the thought conveyed. To that end I resorted 
to all sorts of expedients, some of them doubtless ridiculous. 
To encourage her I once applauded her by clapping my hands 
after she had finished reading a page. That pleased her, and 
when she finished another page she demanded more applause. 
Finally it came to be understood that whenever she finished 
reading a page all present must break out into riotous hand- 
clapping. This outburst of applause was so pleasing to her 
that she began to seek the opportunity of reading in order to 
provoke it. Often after wading almost through a page and 
observing that she was within a line or two of the bottom, 
she would cease reading, look up with eyes dancing with 
joyous expectation, and exclaim “ Pretty soon patty-cake!” 
(clap). Later on, when handclapping had lost something, of 
its novelty I once became so enthusiastic after she firiished 
a difficult page that I broke out in the chorus of “ Marching 
through Georgia,” beginning, of course, with the words “ Hur- 
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rah! Hurrah!” That also tickled her fancy and for a time 
she read for the purpose of hearing this chorus bellowed by 
the family at the end of each page. At other times she read 
for the, purpose of being tossed up in the air or of being 
taken out to see the stars. When all these failed I fell back 
on rewards and, to some extent, on downright compulsion. 
Her small allowance of candy was cut off and she was given 
to understand that she could have candy only by reading for 
it. If the promise of candy was insufficient to coax her away 
from her dolls and toys a piece would be placed on the table 
in plain sight until she surrendered and expressed a willing- 
ness to read for it. On a few occasions, when everything 
else failed, I even resorted to a light spanking to get her started 
to reading. I mention this fact not because I believe it to be 
a method to be recommended ; but in order to make this record 
a true one. I now feel that by the exercise of a little more 
patience and ingenuity I could have surmounted all difficul- 
ties by more rational methods. By the time she was twenty- 
three months old she began to experience the mental pleasure 
of reading, and the necessity for these methods passed. 

Her reading was supplemented with the cards until her 
vocabulary increased to about seventy-five words. She then 
began to exhibit an aptitude for assimilating new word forms 
which rendered further use of the cards unnecessary. 

In the reading matter specially prepared for her capital 
letters were eliminated entirely except in the case of proper 
nouns. She was reading by the word method in which each 
word is in effect nothing more nor less'than a picture with a 
given name. Considered as a picture, the picture “the” is 
decidedly different from the picture “ The;” and it clearly 
confused the child to hear the same name applied to dissimilar 
pictures. When she was far enough advanced to begin the 
use of printed school primers she no longer had any difficulty 
in recognizing words beginning with capitals. 

The composition book primer was not wholly satisfactory. 
Its leaves were of such flimsy paper that in the hands of a 
baby they were readily torn; and we were obliged to keep it 
out of her reach except when an older person could be present 
to watch over it. To obviate this difficulty I procured a 
sheet of artificial wall-board of the type of “ Beaver Board,” 
and sawed it into pieces about nine_ inches long by seven 
inches wide, on which the lessons prepared for her were 
pasted. The boards so prepared were practically indestruc- 
tible, and served not only as a reading text, but as a toy as 
well, with which the baby might play at her pleasure. Martha 
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took kindly to these boards, and when twenty-three months 
old ordinarily spent as much as an hour each day on the 
floor, playing with the boards, and reading the lessons aloud 
to herself. After she had mastered the contents of some 
fifteen of these boards, had acquired a reading vocabulary 
of about one hundred and fifty words, and had developed 
considerable proficiency in reading, ordinary school primers 
were placed in her hands. 

At the age of twenty-four months she had a reading vocabu- 
lary of over two hundred words. She is at the time of this 
writing twenty-six and one-half months old, and has a reading 
vocabulary of over seven hundred words. In addition to the 
matter specially prepared for her on the boards, and in addi- 
tion to considerable matter mastered in various nursery books, 
she has finished four school primers and is about half way 
through a fifth. Her vocabulary of spoken words is very 
extensive, so much so that I have given up trying to keep 
track of it; but it must be well over two thousand words. Her 
pronunciation has by no means kept pace with her progress 
in reading; but her expression while reading leaves little to 
be desired. 

Because of lack of time very little has been attempted in 
the way of developing her mathematical sense. When she 
was twenty-one months old she had acquired the use of the 
words “one,” “two,” “three,” “four,” “ five,” “ six,” and 
“seven,” but without any concept of the number value ex- 
pressed by the words. At that age I spent many hours, and 
exhausted every resource of my ingenuity in an attempt to 
get her to recognize the number of objects up to three, but 
without success. She had absolutely no mathematical sense 
at that age, although her ability to recognize colors and word 
forms was already well developed. The first glimmering 
of a mathematical sense appeared during her twenty-third 
month, when she began to count small groups of objects cor- 
rectly. By the time she was twenty-four months old she 
recognized-and read the printed numerals up to 100, and cor- 
rectly counted groups of objects up to ten. No effort has since 
been made to develop her mind in this direction. 

Owing to pressure of other matters I have been able to give 
her little attention since her twenty-fourth month; and \for 
some time have devoted to her only a half hour or so in the 
evening two or three times a week; so that her development, 
considerable as it is, by no means approaches the limits of 
possibility. Indeed, I am much impressed with the idea that 
the limits of the baby mind have never been sounded. It 
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appears to be capable of performing feats beyond the powers 
of the mind of either the adult or the child of school age. As 
an illustration, it is no unusual thing for Martha, when condi- 
tions are favorable, to cover twenty pages of simple new 
matter in a primer and add twenty or more new words to 
her vocabulary in a single session of half an hour. The in- 
stant her eye encounters an unfamiliar word she exclaims 
“What’s that?” I pronounce the word for her once, or at 
most twice, have her repeat it, and it is stamped in her mem- 
ory ; and thereafter she recognizes and pronounces it in what- 
ever connection she meets it. In doing this she receives no 
aid from phonics. Up to the present time she reads by the 
word method only. The lightning-like rapidity with which 
her nind, apparently without effort or concentration, assimi- 
lates new word forms is almost uncanny. Since beginning 
this article I have had an opportunity to put this ability to a 
somewhat strenuous test. I brought the child to my office to 
spend the day with me away from the distracting influences 
of family life. I gave her a primer she had not previously 
seen—“ Gordon's Reader, Book I.” She read, with frequent 
intervals of happy play, for about three hours and a half, 
when she rebelled and refused to read further. During this 
period she covered the first forty-four pages of the primer 
(excluding three pages of verse), or a total of 2,464 words. 
In this number of pages she encountered fifty-one unfamiliar 
word forms, which were pronounced for her until she was able 
to repeat them, but which were not reviewed. The book was 
then put away for thirty hours, at which time of the fifty-one 
new words she recognized thirty-eight and failed on thirteen. 

As the. baby mind doubtless foreshadows the mind of the 
child of school age, a fact observed during the course of the 
experiment should be of interest to the educator. While it 
is true that her baby mind is capable of feats beyond the 
powers of older minds, this power displays itself in its highest 
perfection only during those hours of the day when her 
physical vitality is at its best. When physical weariness super- 
venes the collapse of the mental powers is more absolute and 
complete than in the case of an older child. In Martha’s 
case, her mental powers are not at their highest immediately 
after awakening from a refreshing sleep. They begin to 
sparkle about two hours after she awakes, blaze forth in their 
greatest brilliancy four, five, or six hours after awakening, 
and then gradually decline. As bed time approaches they 
die out almost completely. Then, even if she expresses a 
desire to read, as she often does, her mind wanders from the 
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printed page, she is unable to assimilate new word forms, 
which leave no impression on her memory, and she completely 
forgets words with which she has long been familiar. 

Since undertaking the experiment | have been warned by 
kindly friends against “ over-taxing” the baby’s mind, and 
have been favored with citations from the works of educators 
containing grave warnings against straining the mental powers 
of the young. The answer to such warnings appears to me 
to be, first, that the baby mind is naturally intensely active, 
and if Martha had been left to her own devices during the 
periods devoted to teaching her, her mind would have been 
just as actively occupied with something of no ulterior value 
to her as it was in fact occupied with learning to read; and 
second, that it is impossible to drive the baby mind beyond that 
which affords it pleasure, whether such pleasure is found 
in an act itself or in anticipation of a reward for doing the 
act. I have stated that at one stage in her development I 
occasionally lightly spanked her to get her to read, and, un- 
explained, this statement might imply that I thereby forced 
her to mental effort. The fact is, however, that the spanking 
merely served to wrest her attention from dolls and toys. 
When her attention was so diverted I directed it to the reading 
matter, a new interest and pleasure supervened, and she forgot 
her dolls. When the time comes, as it often does, when 
reading ceases to be a pleasure to her, and her interested 
attention can no longer be commanded, | have yet to discover 
a method of forcing her to proceed. 











AESTHETIC JUDGMENTS OF SCHOOL CHILDREN 


By AnNaA BERLINER 


The problem in these experiments was to find how various 
groups of children would rank a series of picture cards accord- 
ing to the aesthetic value of the pictures. The experiments 
were carried on with nine groups of twenty grammar school 
boys and nine groups of twenty grammar school girls chosen 
at random from the grades 8B, 6B, 6A, 5B, 5A, 4B, 4A, 
3B, and 3A of the Hebrew Orphan Asylum, New York 
City. The material used for the ranking consisted of 16 
picture postals representing illustrations of rhymes and songs 
for children. The pictures were spread out at random on a 
table, and the child asked to find the most beautiful of all. 
As soon as the child had selected a card he was told to find 
the most beautiful of those that were left. This demand was 
repeated again and again until the child understood that he had 
to go on finding the most beautiful of those that remained. 
Each child was taken separately and was not allowed to see 
how the other children arranged the cards. The average posi- 
tion for each card was calculated, and the resulting eighteen 
series of values were correlated in the following way: each 
group of boys was correlated with each group of boys; each 
group of girls was correlated with each group of girls; and 
finally each group of boys was correlated with the corre- 
sponding group of girls, so that class 8B of the boys was 
correlated with class 8B of the girls, class 6B of the boys 
was correlated with class 6B of the girls, and so on. The 
correlations were found by the product-moments’ method of 
Pearson. They are given in table 1, table 2, and table 3. 
With one exception (table 3, 6 A) all three tables show high 
correlations and a small probable error, a fact which justifies 
the following conclusions : 


1. Between the limits of grade 8 B and grade 3 A, and under 
our conditions, the ranking order of a group of pictures is to 
a high degree the same for all the grades. 

2. Between the limits of grade 8 B and grade 3 A, and under 
our conditions, the ranking order of a group of pictures is to 
a high degree the same for both sexes. 
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TABLE 1* 


CORRELATIONS OF Boys’ CLASSES WITH Boys’ CLASSES 
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The figures beneath the correlations 
give the probable errors. The averages are calculated from three positions. 


* All correlations are positive. 
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TABLE 2* 


CORRELATIONS OF GIRLS’ CLASSES WITH GIRLS’ CLASSES 
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* All correlations are positive. 


give the probable errors. 
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TABLE 3* 


CORRELATIONS OF Boys’ CLASSES WITH GIRLS’ CLASSES 


Lon | 
‘) 
@ 


8B 0.78 0.07 
6B 0.66 0.09 
6A 0.06 0.17 
5B 0.77 0.07 
5A 0.56 0.11 
4B 0.78 0.07 
4A 0.60 0.11 
3B 0.60 0.11 
3A 0.76 0.07 
= 

_- 0.62 

9 


* All correlations are positive. 


The tables do not suggest any development in the aesthetic 
judgment between 3A and 8B. The question is whether 
there is a slight development in the judgment, a development 
so slight that it is covered as long as we consider only each 


class by itself. If we take the sum of the correlations of. 


each class with its first and second neighbors for all the classes, 
and divide this sum by the number of correlations that enter 
into the sum, we obtain for the boys 0.620 and for the girls 
0.895. If we determine in the same way the sum of the corre- 
lations of each class with its third and fourth neighbors and 
divide this sum by the number of correlations that enter into 
the sum, we obtain for the boys 0.620 and for the girls 0.883. 
Comparing these two pairs of numbers we find that the girls 
as well as the boys show a tendency to correlate higher with 
those classes that are near in grade than with those that are 
farther removed. The same tendency is brought out in the 
following way. We consider the averages of the correlations 
of each class with each class as represented in the last row 
of table 1 and table 2. We omit 8B because the difference 
between 8 B and the following grade is greater than that be- 
tween the others and their first neighbor. We take the four 
outer and the four inner grades together, forming the sum 
of 6B, 6A, 3B, 3 A, on the one hand and that of 5B, 5A, 
4B, 4A, on the other hand. The sum for the outer group 
is 2.32 for the boys and 3.31 for the girls. The inner group 
gives the sum 2.69 for the boys and 3.55 for the girls. The 
correlations for the inner groups are higher than those for the 
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outer groups. There exist more classes that are near in grade 
for the inner groups than for the outer groups. The greatest 
difference between an outer class and the class it is correlated 
with is seven grades; the greatest difference between an inner 
class and the class it is correlated with is four grades. We 
thus find again the same tendency to higher correlation in 
the classes that are nearer neighbors than in those that are 
farther removed. 
TABLE 4 


CORRELATIONS OF GRAMMAR SCHOOL GROUPS WITH COLLEGE GROUPS 


Columbia Barnard 

? p. e. s p.e 
8B +0.08 +0.16 —0.41 +0.14 
6B —0.34 +0.15 —0.49 +0.13 
6A +0.25 +0.16 —0.60 +0.12 
5B —0. 28 +0.16 —0.51 +0.12 
5A +0.04 +0.17 —0.46 +0.12 
4B —0.27 +0.16 —0.36 +0.15 
4A +0.19 +0.16 —0.54 +0.12 
3B —044 £0.14 —-0.33 +0.15 
3A —0.16 +0.16 —0.56 +0.12 
>| 
: na eee ee —0.47 


The same experiment was carried on with a group of 20 
Columbia students and a group of 22 Barnard students. The 
correlations between the ranking of the Columbia students 
and the boys’ classes are given in table 4 under Columbia; 
the corresponding values for the Barnard students and the 
different girls’ classes are shown in table 4 under Barnard. 
The table gives only negative correlations under Barnard and 
contains five negative and four positive correlations under 
Columbia. The correlations in the girls’ group are high enough 
and the probable errors small enough to allow the conclusion 
that the selective principle in the Barnard group is the opposite 
of the selective principle in the grammar school groups. Not 
only is there no agreement between the taste of the College 
and that of the grammar school girls, but the Barnard group 
judges those pictures beautiful that the children consider least 
attractive, and the children prefer those pictures that the stu- 
dents reject in their aesthetic judgment. The same holds true 
with the groups of school boys and the Columbia College stu- 
dents, although the relation does not come out as clearly as 
with the girls. The average of the sum of all the correlations 
between Columbia and grammar school groups is —0.10. The 
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corresponding figure for the girls’ groups is —0.47. We are 
thus allowed to conclude: 


3. Whereas there is a high uniformity in the group taste 
of all the grammar school classes for boys as well as for girls, 
there is an absolute break between the group taste of the gram- 
mar school classes on the one hand and the college on the 
other hand. 


A control experiment was introduced to determine whether 
the break between grammar school and college groups is 
caused by the age difference or by the difference of the social 
standing of the observers. A group of ten children from 
grade 2, 5, 6, 7, all belonging to families from the upper 
middle classes, were asked to rank the pictures in the same 
way as the children from the orphan asylum had done.’ This 
group was compared with a group from the orphan asylum 
consisting of children from grade 3, 4, and 5. The correla- 
tion coefficient is +-0.44 with a probable error +0.14. This 
correlation is lower than all the correlations in table 2. Con- 
sidering however that the control group consists of only ten 
observers, and that both groups which enter into the correla- 
tion are mixed groups, a correlation which is more than three 
times as high as its probable error seems high enough to 
deserve consideration. How much in such mixed groups the 
coefficient is influenced by chance is shown by the fact that 
the correlation of the control group with an unmixed group, 
class 5 A,—selected at random—is +0.52 with a probable 
error +0.12. 

The coefficient of the control group with the Barnard 
group is —0.25 with a probable error +0.16. This correla- 
tion, like all the coefficients between the grammar school and 
the Barnard groups, is negative. It is lower than the other 
coefficients, but it nevertheless brings out quite clearly the 
fact that the taste of the two groups tends to go in opposite 
directions. The control experiment thus justifies the con- 
clusion : 


4. The break between the grammar school children and the 
college students is not due to a difference in the social standing 
of the two groups but to the age difference. 


If we compare the correlations in the grammar school as 
given in table 1 and table 2, we notice that the figures are 
much higher for the girls than for the boys. This relation 
is best seen by considering only the figures for the sum of 
the correlations of each class with each other class as shown 





1 This experiment was conducted by Miss Mary C. Doremus. 
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in the last row of the two tables. This sum is higher for each 
single class in the girls’ table than in the boys’ table. The 
lowest figure in the girls’ table is higher than the highest in 
the boys’ table. If we add these sums and divide them by 
the number of grades represented in the table (9), we obtain 
for the boys 0.614 and for the girls 0.847. The average devia- 
tion is 0.07 and 0.04 respectively. We thus conclude: 

5. Different groups of girls agree more closely in their 
aesthetic judgment than groups of boys. 

It is interesting to note that the boys correlate just as high 
with the girls as with one another. The average correlation 
of the boys’ groups with one another is 0.61; the average cor- 
relation for the corresponding classes of the two sexes is 0.62. 

Another sex difference is brought out by the comparison 
of the standard deviations, ¢, of the average positions of the 
pictures as given in table 5. The standard deviation is smaller 
in each grade for the boys than for the girls. The average 
sum of the deviations is 36.69 for the boys and 57.70 for the 
girls. The mean deviation of these deviations is 2.28 and 3.40 
respectively. We thus conclude: 


6. The average positions of the pictures differ more from 
one another in groups of girls than in groups of boys. 


TABLE 5 
STANDARD DEVIATIONS OF THE AVERAGE POSITIONS OF THE PICTURES 

Boys Girls 
8B 33.1 < 65.9 
6B 40.9 < 56.0 
6A 34.3 < 62.5 
5B 37.0 < 60.3 
5A 35.1 < 57.9 
4B 35.5 < 53.8 
4A 36.9 < 54.6 
3B 42.2 < 53.2 
3A 35.2 < 56.1 

36.7. < 57.7 


o|™M 


A similar relationship is brought out by the comparison of 
that measure of variability which has been introduced by 
Hollingworth into the psychology of ranking, i. e., the ratio 
M.V./P.2_ M.V. designates the average variability and P the 


2 Hollingworth, H. L. “Judgments of the Comic,” Psychol. Rev. 
vol. 18, 1911, p. 143. See also the same author’s “ Experimental Studies 
in Judgment,” 1913, pp. 116-117. 
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total number of positions in the scale; M.V./P. thus desig- 
nates the average variability divided by the number of posi- 
tions. The values for this ratio are given in table 6. The ratio 
is higher in each grade for the boys than for the girls. The 
average for the boys is 0.221, that for the girls 0.180. The 
average deviation is 0.0038 for the boys and 0.009 for the 
girls. These facts allow the conclusion: 

7. Inside the group the girls agree more closely in their 
aesthetic judgment than the boys.* 

The same relationship obtains again for the Columbia and 
Barnard group, M.V./P. being equal to 0.210 for the men 
students and 0.177 for the women students. 

It is evident that there is a certain connection between 
the sixth and the seventh conclusion. If all the observers had 
exactly the same taste, so that each observer would choose 
that picture as first that all the other observers considered 
best, and if this held good for the second, third, and all the 
other choices as well, then the standard deviation for the aver- 
age positions from their arithmetical mean would be a maxi- 
mum and the M.V./P would be a minimum. In this case 
M.V./P would be zero and o would be determined only by 
the number of pictures. On the other hand, if there were no 
agreement in the taste at all, we would obtain the same rank 
order as if such order were determined only by chance. If 
in this case a large enough number of observers is taken all the 
pictures will have the same average positions, and o will be a 
minimum, namely zero. In this case the M.V./P will reach 
its maximum, which is for any number of pictures 0.250 as 
long as the number of positions is the same as the number 
of stimuli which have to be distributed over these positions.* 
In these two cases there is a one-to-one relation between o and 
M.V./P. But this one-to-one relation subsists only in these 





8 With regard to experiments giving smaller variability for girls 
than for boys compare William Stern, Differentielle Psychologie, 1911, 
pp. 276-278. 

4 If the number of observers is large enough each picture takes each 
position just as often as each other position so long as we have no 
selective principle but only a chance distribution. In case we have x 
positions, x pictures, and n observers (n being great enough) we obtain 
the same value for M.V./P. as if each picture takes each posi- 
tion only once. In this case each picture takes once the position 1, 
once the position 2, once the position 3, and so on up to position x-1 
and finally position x. The arithmetical mean of all the x positions is 


x (x+1) x+1. 


2x 2 
average position are: 





The deviations of the single position from this 
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extreme cases ; in general there is a certain mathematical inde- 
pendence between these two values. Only some of the changes 
in the one factor influence the other factor; other changes 
are without effect. The fact that there is a certain mathe- 
matical independence proves that the conclusions 6 and 7 
have each a meaning for itself. The same fact may be 
brought out by comparing the o and the M.V./P values in 
the following way. If we arrange the os of the boys accord- 
ing to their values beginning with the lowest and ending with 
the highest, we obtain the series: 8 B,6A,5A,3A,4B, 4A, 
5B,6B,3B. Arranging the M.V./P values in the opposite 
way, beginning with the highest and ending with the lowest, 
we obtain the series: 8B, 5A, 6A, 3A, 4B, 5B, 4A, 6B, 
3B. The two series agree quite well but not so closely as 
they would in the case of a mathematical connection. We 
obtain the same result by comparing the corresponding values 
for the girls, as may be easily seen from table 5 and 6. 

If instead of comparing the M.V./P’s of the boys and the 
girls we consider the variability of the individual cards in 
the groups of boys and the groups of girls, we find another 
sex difference which, although not so pronounced as the three 
preceding sex differences, may be noticed easily in table 7. 
Since we are interested only in a comparative study of the 
two sexes, and since the number of stimuli as well as the 
number of positions is the same in all groups, the gross varia- 
bility gives just as good an insight and is more exact than the 
ratio M.V./P, for small differences might be easily covered 
by the division by the number of positions. The average devia- 
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Adding these deviations we obtain The average of this sum 


x 1 
gives M.V.—— and M.V./P=—— 0.25. For odd numbers we 
4 


x—l 1 
obtain M.V./P = —— —. The greater x, the nearer will M.V./P be to 
x 4 
. x—1 a 
0.25; for x= 11, it is already 0.99 times 0.25, limit —_ _. _ — 0,25. 
4x 


The ratio M.V./P can never be greater than 0.25 nor smaller an 0.’ Thus 
this relation holds for odd as well as for even numbers. 


“ 
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TABLE 6* 


M. V./P OF THE AVERAGE POSITIONS OF THE PICTURES 


Boys’ Girls 
8B 0.226 > 0.159 
6B 0.216 > 0.187 
6A 0.224 > 0.168 
5 B 0.222 > 0.174 
5A 0.225 > 0.183 
4B 0.223 > 0.191 
4A 0.219 > 0.189 
3B 0.212 > 0.192 
3A 0.224 > 0.181 
= 0.221 > 0.180 
9 


* All correlations are positive. 


TABLE 7 


VARIABILITY OF THE BETTER AND POORER CARDS 


Boys Girls 

Good Bad Good Bad 

cards cards cards cards 
8 B 29.895 > 28.005 19.145 < 21.595 
6B 27.66 > 27.585 22.99 < 24.84 
6A 29.255 > 28.19 20.395 < 22.705 
5B 28.695 > 28.085 20.30 < 24.26 
5A 30.785 > 26.715 23.235 < 23.73 
4B 29.035 > 28.145 24.655 > 24.14 
4A 26.28 < 29.79 25.28 > 23.185 
3B 27.51 > 26.785 26.11 > 22.95 
3A 29.075 > 28.17 22.085 < 24 22 
> : 
"4 28.688 > 27.936 22.688 < 23.514 


tions are divided up so that the eight better cards are taken 
together, and the eight poorer cards together. The sums of 
the average deviations of the better cards are given under 
“ good cards,” and the sums of the average deviations of the 
poorer cards are given under “bad cards.” With the excep- 
tion of one class, the figures for the boys are greater in the 
first column than in the second column. The boys agree more 
closely in their dislikes than in their likes. The opposite 
relation obtains with the girls. The girls agree more 
closely in their likes than in their dislikes, although this rela- 
tion is not so clear as that with the boys, three classes being 
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different from the others. We are nevertheless allowed to 
conclude: 


8. Boys agree more in their dislikes than in their likes; girls 
agree more in their likes than in their dislikes. 


Comparing the Columbia and Barnard groups in the same 
way we see that here too the same relationship obtains. The 
figures for the Columbia group are in the good half 27.50 and 
in the poor half 26.37. The Barnard group gives 22.54 and 
22.64 respectively. The same results were obtained—as far as 
girls are concerned—by Hollingworth with a group of ten 
girls in experiments on the judgment of the comic.* In his 
experiments on the judgments of persuasiveness, however. 
Hollingworth found the opposite relation with a group of 
twenty boys and a group of twenty girls.* Nor did the results 
agree in experiments which the present writer made with dif- 
ferent groupsand different material on theaesthetic judgment.’ 

If we combine, instead of the good and bad cards, the 
extreme and middle cards, taking together the cards that 
occupy the first, second, third, fourth, thirteenth, fourteenth, 
fifteenth, and sixteenth position on the one hand, and all 
the other cards on the other hand, we obtain results as repre- 
sented in table 8. Column 1 and column 2 compare the 


TABLE 8 


VARIABILITY OF THE EXTREME AND MIDDLE CARDS 





Boys Girls Boys Girls 

Extreme Middle Extreme Middle Differ- Differ- 
cards cards cards cards ence ence 

8 B 28.935 < 28.965 17.805 < 22.935 0.080 < 5.130 
6 B 27.485 < 27.810 22.490 < 25.340 0.375 < 2.850 
6A 28.820 > 28.625 19.185 < 23.915 —0.195 < 4.730 
5B 26.715 < 30.015 18.710 < 25.850 3.300 < 7.140 
5 A 28.225 < 29.275 20.775 < 26.190 1.050 < 5.415 
4B 27.265 < 29.915 23.280 < 25.515 2.650 > 2.235 
4A 26.620 < 29.450 21.405 < 27.060 2.830 < 5.655 
3B 26.515 < 27.780 23.195 < 25.865 1.265 < 2.670 
3A 28.020 < 29.225 22.785 < 23.520 1.205 > 0.735 
= 
> 27.617 < 29.007 21.070 < 25.132 1.390 < 4.062 
51. ¢., p. 141. 


* Hollingworth, H. L. “Judgments of Persuasiveness.” Psychol. 
Rev., vol. 18, 1911, p. 256. 

7“ Correlation between Aesthetic and Recognition Value” to be pub- 
lished later. 
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extreme and middle values for the boys; column 3 and 4 show 
the corresponding values for the girls. With but one excep- 
tion the variability ‘is smaller in the extreme values than in 
the middle values.* Column 5 and 6 give the differences 
between these two groups for the boys and girls. With two 
exceptions these differences are smaller with the boys than 
with the girls. The table thus allows the conclusion: 


9. The difference in the variability between the extreme and 
middle pictures tends to be greater in groups of girls than in 
groups of boys. 

This relation is not found in the Barnard and Columbia 
group. ’ 

The fact that our experiments yield a considerable number 
of values for the M.V./P allows us to get a certain insight 
into this ratio. Before turning to our values, however, it is 
necessary to consider the literature about this problem. Hol- 
lingworth introduced the ratio M.V./P instead of the crude 
M.V. used by Wells in his experiments on the variability of 
individual judgment.® Wells in his comparison of the rank- 
ing with different material (preference of picture postals, dif- 
ference in pairs of colors, and weight), comes to the con- 
clusion: “It has appeared that in the first class the judgments 
of the individual cluster about a mean which is true for that 
individual only, and which varies from that of any other indi- 
vidual more than twice as much as its own judgments vary 
from it; that in the second class, with the colors, the varia- 
bility of the successive judgments and those by different indi- 
viduals markedly approached each other, but still preserved a 
significant difference ; while in the third class, with the weights, 
we found that there might be even an excess of the individual 
variability over the ‘ social.’ This comparison seems to afford, 
to a certain extent, a quantitative criterion of the subjective.’”*° 

Instead of using this ratio of the individual and _ social 
variability, the “ Inter-Intra-Quotient,”** Hollingworth pro- 
poses the M.V./P: “ This ratio M.V./P can then be used as 


8 The same results were obtained in five other group experiments 
with college students. Cf. “Correlations between Aesthetic and 
Recognition Value.” 

® This problem is only part of the general problem of the reduction 
of measures of variability for comparative purposes. We need not 
enter into this general problem since our interest centers only around 
the specific reduction by the number of positions. 

10 Wells, Frederic Lyman. “On the Variability of Individual Judg- 
ment.” Essays philosophical and psychological in honor of William 
James, pp. 547-548. 

11 Stern, William. I. c., p. 259. 
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a reliable index of the objective character of judgments and 
With a greater accuracy than the crude M.V. employed by 
Wells ;"** and again: “The size of this ratio would become 
smaller as the material came to be selected so as to disclose 
more pronounced or more objectively measurable differences.”** 
Comparing different material which has as the only constant 
factor the basing of the judgment on the affective reaction to 
the stimulus, Hollingworth finds that with different groups 
of observers and with a widely ranging value for P, M.V./P 
is usually 0.20, and with high reliability.** In contrast to 
experiments where the judgment is based on the affective re- 
action to the stimulus Hollingworth observes that in experi- 
ments with more objectively measurable differences this ratio 
becomes smaller. Thus figures gained by Downey in experi- 
ments in the judgments of resemblance of penmanship yield, 
according to Hollingworth, M.V./P=0.165, =0.157, and 
== 0.168." Wells’ experiments with colors and weights give 
M.V./P =0.086 and M.V./P 0.136 respectively. In his 
later publication, however, Hollingworth suggests giving up 
the difference between objective and subjective judgment: 
—judgments of intensity, etc., will vary as much as those 

of preference if the differences afforded by the material are 
sufficiently slight.”"*° And again: “It is to be expected that 
various sets of material, of the same content but with differing 
degrees of difference between successive items would show 
the same difference in ‘ subjectivity ’ as those found with dif- 
ferent kinds of material.”** Our material supports this con- 
clusion. We find values for the ratio M.V./P as high as 0.226 
and as low as 0.159. Hollingworth’s table representing ten 
different groups shows as the highest value 0.250 and as the 
lowest 0.180.‘ Taking Hollingworti:’s and our own material 
together, we thus find a variation between 0.159 and 0.250. 
These figures are taken only from experiments based on a 
“subjective ” category. The more “ objective ” experiments 
on the resemblance of penmanship vary in this ratio from 
0.157 to 0.168. The still more “ objective” experiments of 
Wells show a ratio of 0.136 for weights and a ratio of 0.086 





12“ Judgments on Comic,” p. 145. 

13 [bid., p. 163. 

14 Jbid., p. 145. 

15 Jbid., p. 145. 

16 Hollingworth, H. L. “ Experimental Studies in Judgment,” 1913, 
pp. 116-117. We consider here only the one side of Hollingworth’s 
analysis of the subjective, “the ratio of variability to series length.” 

17 [bid., p. 144. 

18 Jbid., p. 144. 
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for colors. Since Hollingworth’s calculation makes the rank- 
ing of the weights appear more subjective than the ranking 
of the colors, and since this is in direct opposition to Wells’ 
interpretation, we are justified in taking these two experi- 
ments in one class. Instead of taking Wells’ ten observers 
together as Hollingworth did, I separate Wells’ normal and 
abnormal observers, and thus obtain M.V./P 0.155 for the 
abnormal and M.V./P 0.107 for the normal group in the 
experiment with weights.’ We thus obtain the following 
variations for our different groups: 


1( based on affective tone...............-008: 0.250-0.159 
2) resemblance of penmanship .............. 0.168-0.157 
rs eer ae 0.155-0.107 


The first and second groups overlap one another to a great 
extent, and the second and third groups come very close to 
one another. In view of the fact that the ratio M.V./P can 
vary only between 0 and 0.250, the variations of the first group 
are very considerable. It seems unjustifiable to select one 
value like M.V./P 0.200 as a representative value for the 
first group. The ratio M.V./P is a function not only of the 
category of the judgment but of the group that judges and of 
the material judged. We may obtain the same value for 
M.V./P with so-called subjective as with so-called objective 
judgment. The M.V./P is a measure for the strength of the 
selective principle in regard to a given group and a given 
material. We measure the strength of this selective principle 
by the position of the M.V./P in the series of values repre- 
sented by all possible values between 0 and 0.25. In a case 
where the selective principle is absolute, the M.V./P will be 
zero; in a case where the selective principle is so weak that 
the distribution is due only to chance, the ratio will be 0.25. 
Thus in the case of the ten observers who arranged 35 adver- 
tisements according to their persuasiveness (see Holling- 
worth, Judgments, on Comic, p. 144), the selective principle 
was so weak that it did not have any effect at all. The 
arrangement found there with ten observers was the same 
as a mathematical calculation would give. This example shows 
the importance of the M.V./P for the psychology of the rank- 
ing of advertisements. Only in case the M.V./P is smaller 
than 0.25, is the ranking of significance. Only in that case 
does there exist a principle of selection. 





19 Wells. |. c., p. 545. 


























RATE OF IMPROVEMENT OF THE FEEBLE-MINDED 
AS SHOWN BY STANDARDIZED EDUCA- 
TIONAL TESTS 


By KaTHARINE Murpocu, Columbia University, Extension Department 


This study is an attempt to compare the rate of progress 
made by feeble-minded, with that of normal children, of the 
same mental age, in elementary school subjects. The subjects 
of the experiment were twenty-one feeble-minded individuals, 
who are at the State Institution for the Feeble-minded, at 
Polk, Pa. The selection of individuals in the institution was 
made upon the basis of school grade. It was requested that 
all school pupils in Grades IV, V and VI (the highest grades 
represented in the institution), should take part. There were 
37 pupils in these grades who took part in at least one of the 
tests the first year they were given. One year later, however, 
when the tests were repeated, only 21 of the original pupils 
were available. The others either had left the institution, or 
were ill, or were otherwise employed. The results of the 21 
who completed the tests only, are given here. All of these 
pupils but one, were still in school when the second set of 
tests was given, the one having dropped out in June, 1917. 

The first set of tests was given during the last week of 
1916 and the first week of 1917. I have called this the 1917 
set of tests. The second set of tests was given one year 
later and is called the 1918 set. Exactly the same tests were 
given both years, and the procedure of giving them, insofar 
as it was possible to make it so, was identical. All tests were 
given by the writer. The tests were as follows: (1) Those 
given individually: Terman Intelligence Test and Sylvester 
form board test. (2) Those given in groups: Trabue Com- 
pletion test, Scale B; Thorndike Visual Vocabulary; Thorn- 
dike Reading, Scale Alpha 2; Woody, Addition, Subtraction, 
Multiplication and Division tests, all series B; Ayer’s Spell- 
ing, list T; Woodworth and Wells, Easy Opposites and Adjec- 
tive-noun tests. The pupils were also directed to write a 
composition entitled “Christmas at Polk,” and to make a 
drawing, each, of a man and of a house. These latter were 
graded by the use of the Thorndike Handwriting Scale, the 
Hillegas Composition Scale and the Thorndike Drawing Scale. 
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The procedure of giving all the tests was exactly that indi- 
cated by the author of each test, and the scoring also followed 
their methods precisely. In case of the composition and draw- 
ing tests, no time limit was given and the final score was the 
median judgment of from four to seven competent judges, 
using the judgment scales referred to. The Handwriting 
judgment was based upon the sample obtained in the writing 
of the compositions. 

The accompanying table indicates the average school grade 
of the pupils in 1917 (some were in a lower grade in arith- 
metic) ; and for both years, the pupil’s chronological age, men- 
tal age (as revealed by the Terman test), and Intelligence 
Quotient. The class averages are given for each year, columns 
4 and 5. In the case of the visual vocabulary (row 9) and 
Ayer’s Spelling test (row 15), a class score was obtained 
according to the directions of the authors of these tests. The 
mean square deviation of the distributions for each year is 
found in columns 6 and 7; the correlations between the 1917 
and 1918 series are presented in column 8, and the sigma of 
these correlations in column 9; the improvement (shown by 
the difference between the class scores for the two years), 
and the mean square error of the improvement are found in 
columns 10 and 11. 

An examination of column 8 immediately introduces inter- 
esting speculation as to the reasons for the very low correla- 
tions found between the 1917 and 1918 tests. The writer 
surmises that this is largely due to the very unequal rate of 
development obtaining in the different individuals. An inspec- 
tion of the range in chronological ages, varying between twelve 
and twenty-three years, suggests one possible cause for this, 
although it does not seem to hold true throughout, by any 
means, that the greatest gains are made by the younger chil- 
dren. Particularly interesting are the low correlations found 
in mentai age, .68, and in 1.0., .79. The former perhaps may 
be partly explained by the fact that many individuals were 
over 16 years of age in 1917 and so would not be expected 
to improve mentally—whereas others were below this age, 
and, according to accepted belief, would be expected to show 
a mental gain in a year’s time. The I.Q. correlation, how- 
ever, is not subject to this explanation, being always the ratio 
of the mental age to the chronological age, unless this latter 
is over 16 years, in which case it is treated as though it were 
16 years. According to Terman, the I.Q. is a constant factor 
in any individual, and the correlation found between the 1.0.’s 
of any group of individuals, obtained upon two occasions, with 
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either a short or long interval of time elapsing, should theoret- 
ically be 1. I believe that the low correlation found in this 
study is due largely to the method prescribed, or at least 
allowed, by Terman, of scoring the tests. This method pro- 
vides, in the testing of defectives, that when one test, at any 
age level is passed, the subject shall be allowed to try all 
tests at the next age level. But though Terman admits that 
the subject may be given opportunity to try at a higher age 
level, even if he has failed on all tests for the preceding year, 
he does not insist upon this procedure, and his own advice 
concerning the desirability of avoiding fatigue suggests to the 
examiner the advisability of stopping when all tests at any 
year have produced failure, particularly when he has already 
spent somewhat more than one hour upon the examination. 
The exaniinations reported here were made in that way, being 
discontinued when there was complete failure at any age 
level, and the method has evidently introduced an error. A 
close inspection of the individual records reveals the fact that 
the lowering of the I.Q. correlations here is due principally to 
the great improvement in mental ages made by five pupils, 
and in each case an examination of the original scores of these 
pupils has revealed that the great apparent gain is due to the 
fact that having passed one or more tests at certain age levels 
in 1918 which were failed utterly in 1917, the door was open 
for success at upper levels, and this success in the case of 
these five subjects was rather remarkable. The most marked 
illustration is that of a girl 13% years old at the time of the 
first test with a mental age of 9, who, because of passing test 
6 at year XII in 1918 (repeating five digits reversed), which 
test she had failed upon the previous year, was given further 
opportunity and succeeded with test 4 at XIV years (problems 
of fact), test 5 at XVI years (repeating 6 digits backward), 
and test 5 at XVIII years, or Superior Adult level (repeating 
seven digits backward), and advanced to a mental age of 11. 
The greatest advance in mental age, namely, from 8-2 to 10-6, 
was made by a boy 17 years old at the time of the first test. 

The average mental age in 1917 was found to be 9 years 
and 2 months. Since the purpose of this study is to compare 
the rate of progress of these feeble-minded individuals with 
that of normal children of the same mental age, norms are 
given in our table, where such are known to the author, for 
normal children in the 3rd and 4th grades (columns 12 and 
13). These norms represent a near approach to the normal 
performance of children of 9 years and 2 months, and those 
of children one year older. This fact was determined from 
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a study by Kelly (reported in Teacher’s College Record, Sept. 
1917), of a completion test language scale, in which norms 
are given for both ages and grades, and it was inferred that 
the same relation between age and grade which was found by 
Kelly, would obtain, at least approximately, in all the tests 
reported in this article. (From Kelly’s figures, by interpola- 
tion, we find more exactly, that children of 9 years and 2 
months correspond to Grade 2.8+-.) The author regrets that 
the actual progress of the same normal children, made in a 
year’s time, could not have been used for comparison, instead 
of norms for two successive school grades, but in the absence 
of the desired data, the difference between’ these norms for 
grades 3 and 4 surely offers a reliable estimate of the improve- 
ment which would be made by a group of normal children of 
9 years and 2 months, who would repeat the tests after an 
interval of one year. 

The norms here reported for normal children in grades 3 
and 4 are to be found in the original report of the tests given 
by their various authors in the case of the Terman Form 
Board, Trabue and Woody tests. In the Thorndike Reading 
test and the Hillegas Composition Scale, no norms are given 
below the fourth grades. In the Ayer’s Spelling test, scores 
for the T list are not given below the fifth grade. The norms 
here given for the Hillegas Composition Scale are published 
in the Teacher's College Record of January, 1917, as tentative 
standard scores obtained from results in eleven city school 
systems. The handwriting norms are from an unpublished 
study made in the Department of Educational Administration 
at Teacher’s College, from results obtained in eight cities. 
Many of the standard scores are in terms of medians. These 
medians, however, have been obtained from large groups in 
which the distribution probably followed the normal curve, 
so, for practical purposes, they are quite comparable to the 
averages used in the present study. 

In every case of the school subjects in which comparison 
can be made between the feeble-minded and the normal, it 
will be seen that our group of feeble-minded children in 1917, 
did better than normal children of the same mental age, an 
interesting corroboration of Goddard’s belief that feeble- 
minded can do more at certain tasks because they have had 
much more practice with them. This is true of the Language 
Completion test (row 8), of the four operations of arith- 
metic (rows 11-14), and of handwriting (row 16). The 
Thorndike Reading Scale norms (row 10) show that the 
feeble-minded in 1918 did better in this test than normal chil- 
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dren of the same mental age (4th grade). In Composition 
(row 17), however, the reverse is true, normal fourth graders 
outranking our group in 1918, by a score of 35 to 31.65. 
In many of the tests we seem to be at, or near, a point where 
the “overtaking” is taking place, for we must now turn to 
our original problem, which was to compare the rate of im- 
provement of the two groups. 

Here our data seem all to point unreservedly to one con- 
clusion, which is that the rate of learning of feeble-minded 
children in these elementary school subjects is less than the 
rate of normal children at the same mental level. The form 
board test (in which the score is in terms of time taken to 
put the blocks in position), the language completion test, all 
the arithmetic tests and handwriting all give the same results. 
The same is furnished by the reading scale (row 10), if com- 
parison is made between the amount of improvement made 
in one year by normal children starting in the fourth grade. 
The fifth grade norm given by Thorndike is 5.75, which shows 
a gain of .50 in one year. The feeble-minded children gained 
only .16 in one year. The same comparison between the Fourth 
and Fifth Grades in Composition (4th Grade 35, 5th Grade 
40, row 17), shows a much larger gain made by normal than 
by feeble-minded children in one year’s time. The same thing 
can be seen by studying Ayers’ norms for Spelling, row 15. 
Improvement in any of his spelling lists, from one grade to 
the next, is much greater than the gain made by our group 
in the T test. 

One possible explanation of these results might be that the 
instruction of the feeble-minded group was poor, and that the 
time they spent in school was less than is the case with normal 
children. I believe, from consulting with the Superintendent 
of the Institution, that the second of these conditions does 
exist, but that, on the other hand, the instruction is given 
in small classes and by competent teachers, and can therefore 
be supposed to be above the average of schooling in general. 
This fact would probably offset the other, that the length of 
time spent in school each day is slightly less than in the case 
of most children. 

The most probable explanation for our results seems to lie 
in the subjects themselves. Common sense has long been 
of the opinion that feeble-minded children learned less quickly 
than normal children at their same mental level, and our 
results would seem to add little to our knowledge, were it 
not for the findings of Woodrow, reported in the Journal of 
Educational Psychology, February, 1917. Woodrow trained 
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groups of feeble-minded and of normal children of the same 
mental age, in a geometrical form sorting test, and found that 
the rate of improvement for the two groups was similar. 
These results, Woodrow thinks, “strongly suggest that it is 
not inability to learn which characterizes incapacity for mental 
development, but inability to grow. ” The results 
of the present study seem to indicate that if the term “ learn- 
ing” can be properly applied to improvement in the elemen- 
tary school subjects, that “ inability to learn ”—at least at the 
average rate—does then characterize incapacity for mental 
development. The discrepancy between Woodrow’s results 
and those reported here seems to the present writer to be 
due to a difference in the test material used. Woodrow’s test 
was one of pure habit formation, in which little analysis or 
abstract activity was required. Since it is in just this power 
to respond by partial activity or analysis that the feeble- 
minded are below the normal, in the opinion of many writers, 
one would naturally expect to find improvement in functions 
demandirig this ability to be less than in cases of concrete 
habit formation, and this is what has been found in this 
investigation. 

As for so-called mental age, whatever this well-known term 
may mean, according to the results of the present study, it 
does not mean either ability to do the same grade of work 
as that done by others of the same mental age, in most of the 
elementary school subjects; nor does it mean ability to make 
the same rate of progress in these same school subjects. 





A GROUP POINT SCALE FOR MEASURING GEN- 
ERAL INTELLIGENCE, WITH FIRST RESULTS 
FROM 1,100 SCHOOL CHILDREN’ 


By S. L. Pressey and L. W. Pressey 


I. OrIGIN AND PLAN OF THE SCALE 


In the autumn of 1917 the Departments of Psychology and 
Sociology of Indiana University undertook to make a survey 
of a certain county “ X ” in the southern part of Indiana to 
determine the number of mental defectives (feebleminded, 
epileptic, insane) in the county. The writers were to have 
charge of the mental testing done in connection with the sur- 
vey. They were already committed to psychological research 
dealing primarily with the problem of selecting gifted children 
in the public schools for special classes, extra promotion, or 
other special educational treatment. But a combination of the 
two problems, where an educational survey should run parallel 
with a careful sociological study of the community, promised 
results of unusual interest. The reliability. and significance 
of the results obtained in the schools might on the one hand 
be much more exactly determined if these results could be 
correlated with adequate sociological data regarding the indi- 
viduals and localities studied. The educational study (which 
must naturally cover more cases than merely those suspected 
of mental defect) would on the other hand give a much wider 
basis for estimating the total mental make-up of the com- 
munity than would otherwise be gained. 

As a matter of fact the writers hoped to test all the school 
children of the county. Plans for research in the educational 





1 The present article from the Psychological Laboratory of Indiana 
University reports part of the work being done as a result of the crea- 
tion of a special research position in the department of psychology, the 
holder (Dr. Pressey) devoting all of his-time to research. Special 
acknowledgments should, therefore, be made to President W. L. Bryan 
and the University for the unusual opportunities provided ; to Professor 
W. F. Book, director of the Laboratory, for suggesting the problem 
and arranging for research in this special field of work; also for help- 
ful suggestions in organizing and carrying on the research of the year. 
The Group Scale, here briefly descrived, is only part of a larger study, 
carried out under his general direction. The results from this larger 
study will be published as soon as the data can be tabulated and care- 
fully studied. 
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field already made had centered around the development of 
group tests of intelligence. As a method of first selection in 
a search for mentally defective or mentally superior children 
Yerkes, Pintner, and Whipple had already pointed out the 
value of the method ;* group tests were being suggested for 
a similar purpose in the army. But it seemed likely that group 
test ratings might be of considerable further practical educa- 
tional value, because of the growing tendency to divide classes 
into sections according to ability. Particularly in the “ Junior 
High Schools ” there is much interest in any plan which will 
readily give some measurement of the general intelligence of 
all the children in a class as an aid in making such divisions. 

The writers were, however, most interested in a third prob- 
lem of much practical and theoretical importance which also 
called for a group scale for measuring general intelligence. It 
has been generally acknowledged by workers with tests of 
intelligence—from Binet on—that norms vary widely accord- 
ing to the sociological status from which children come.* There 
is a very considerable body of evidence to indicate that we 
need racial norms.* Children coming from homes where 
English is not spoken rate definitely lower than children whose 
home language is English, (see Yerkes, Bridges, and Hard- 
wick, ibid., pp. 64-8). This is only one of the many special 
factors which an examiner may have to deal with.’ It is, 





2 Yerkes in a paper delivered at the annual meeting of the Massachu- 
setts Society for Mental Hygiene, Nov. 1917, Pintner “ The Mentality 
of the Dependent Child, together with a Plan for the Mental Survey of 
an Institution,” Journal of Educational Psychology, vol. 8, 1917, pp. 220- 
238, and Whipple in a report at the meetings of the American Psy- 
chological Association, New York, 1916. 

3W. Stern, The Psychological Methods of Testing General Intelli- 
ence, pp. 50-57; Terman, The Measurement of Intelligence, pp. 114-18; 
Yerkes, Bridges, and Hardwick, A Point Scale for Measuring Mental 
Ability, pp. 73-83. 

+E. D. Rowe, Five Hundred Forty-Seven White and Two Hundred 
Sixty-Eight Indian Children, tested by the Binet-Simon Tests, Ped. 
Sem., vol. 21, 1914, pp. 454-69 ;Redfern H. Loades and S. ae ge Binet 
Tests on South African Natives- Zulus, Ped. Sem., vol. 1917, pp. 
373-83; W. H. Pyle, The Mind of the Negro Child, School ee Society, 
vol. I, 1915, pp. 357-60; B. A. Phillips, The Binet Tests Applied to 
Colored Children, Psychological Clinic, vol. 8, 1914, pp. 190-96; A. C. 
Strong, Three Hundred Fifty White and Colored Children Measured 
by the Binet-Simon Measuring Scale of Intelligence, Ped..Sem., vol. 20, 
1913, pp. 485-515; Dagny Sunne, A Coniparative 7 of White and 
Negro Children, Journal of Applied Psychology, vol: 1, 1917. 

5 The writers are convinced, for instance, that on no one of the 
standard scales of intelligence should country children be judged by 
the same standards as city children. There are numerous elements in 
these scales which are distinctly urban. Country children frequently 
show also a different attitude toward the examination. They are less 
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therefore, obvious that the problem of the exceptional child, 
and in general the problem of adapting school training to the 
abilities of individual pupils, varies according to the variations 
in ability in a given school or locality. The child who would 
be exceptional in one neighborhood might be near the average 
in another. It is much more important that allowances for 
differences in ability be made in a school showing wide range 
in ability,—a school containing a number of very dull and very 
bright pupils,—than in a school where the range of distribu- 
tion is narrow. Some measurement giving the average and 
distribution of abilities in the school as a whole should thus 
be the first step in any attempt to adapt the school crganization 
to differences in ability found among children. 
But now the sociological aspect of the problem appears. If 
the worker with mental tests must take account of sociological 
facts, his results should be useful as sociological data. The 
average level of intelligence of the school children of a com- 
munity is the best single indication of the general intellectual 
level of the community as a whole. Facts regarding the dis- 
tribution of abilities in the school population should give in- 
formation of great value as to the homogeneity, make-up, and 
status of the total population of the locality, information con- 
tributing directly to our understanding of such phenomena as 
pauperism, criminality, economic and social status.* 
Whatever might be the case so far as the educational prob- 
lems were concerned, at least for such wholesale testing of 
entire communities as we have just suggested a group scale 
seems clearly necessary. The writers felt that no set of tests 
available was satisfactory for the purpose in hand. They 
desired, in the first place, a scale composed of tests which 
should be applicable over a wide range of ages—if possible, 
from the second grade through high school—and which should 
be highly differential of general intelligence throughout this 





used to strangers and express themselves less readily. The group 
examination has been of great use in the country schools just because 
the country children are often handicapped in such ways, if examined 
individually, but respond readily in the group. The writers feel that 
ratings of intelligence, by both individual and group method, are 
necessary for an adequate measurement of a child’s ability. 

6In fact the community survey by means of mental tests promises 
to be one of the most interesting and valuable of the recent develop- 
ments in the field of mental testing. Its possibilities, in connection 
with social, economic, and also racial problems appeals to the imagi- 
nation as does almost no other branch of the science. See, for example, 
Pintner, “ A Mental Survey of the School Population of a Village”, 
School and Society, vol. 5, 1917, pp. 597-600; D. G. Patterson, “ Mental 
Survey of the School Population of A Kansas Town” School and 
Society, vol. 7, 1918, pp. 84-8. 
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range. They felt, in the second place, that where group tests 
were to be given to younger children special methods for 
obtaining and controlling the attention of the children were 
a necessity if the ratings were, particularly in individual cases, 
to be reasonably reliable. They realized, in the third place, 
that for such extensive practical work and research the tests 
must be very carefully planned and arranged for convenience 
and economy of time and effort in scoring and also for ready 
handling of the data in research. One of the chief aims of 
the psychological study was to obtain a large amount of data 
for the study, by test, of sex, race, environmental and other 
differences. 

An attempt to develop a set of tests which should meet 
these three requirements has resulted in what is here called the 
“Group Point Scale ” for measuring general intelligence. The 
ten tests of the scale were selected from thirty tests experi- 
mented with. The writers made themselves thoroughly 
familiar, by means of Binet ratings, teachers’ estimates, and 
school histories, with the abilities of the children in the third 
and fifth grades of the Bloomington, Indiana, schools, and 
with a group of eighth grade children and High School Sopho- 
mores. It was required of each test, in the first place, that 
the beginning be easy enough and the directions clear enough 
so that nine-tenths of the 3B children would make some score, 
and that the end of the test should be hard enough so that 
no one of the high school sophomores (averaging sixteen 
years old) would make a perfect score. The tests were then 
selected according to their ability to differentiate, at each grade, 
the bright and the dull children. 

Tests which would fulfil to a fair degree the first require- 
ment—range of applicability—were thus selected. The most 
original features of the scale have to do with the attempt to 
meet the second requirement, of careful adaptation in the 
nature of the tests, and in flexibility and ease in control of the 
class, for work with school children. The tests have, the 
writers believe, in an unusual degree an intrinsic interest and 
appeal for children. There is, within the limits set by the 
general plan and organization of the scale, great variety in the 
form of the tests, the content, and the method of giving. The 
directions are such that the children take part, with questions 
and answers from the class, in the explanations of the examples 
preceding most of the tests. There is an alternation of tests 
in which the examiner gives the test item by item with those 
where the task is set and the child is left to himself to com- 
plete it (tests 2, 4, 6, 8, 10). A scale made up wholly of 
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tests of the latter sort, is, the writers feel, unsatisfactory 
for examination of at least the younger school children, by 
the group method.’ Group tests, when given to school chil- 
dren, very often have a stiffness and artificiality which seri- 
ously modifies the results, particularly when (as with intelli- 
gence tests) the individual ratings as well as the class averages 
are to be used. To an observer the present examination is 
much like an ordinary class exercise so far as easy relation of 
examiner to class and friendly co-operation between the two is 
concerned. Much more is, of course, demanded of an exam- 
iner in the way of personality, ready control of the children, 
and thorough grasp of the directions. But good examining 
always requires skill—it might be well if more stress were 
put upon this fact, and less energy expended in trying to make 
' tests “ fool-proof.” The effort of the writers has been to 
arrange an examination such that the skilful examiner might 
develop something of the easy control of his class that a 
good Binet worker has of his single patient. He must be 
able to reach out to this individual or that, stimulate interest 
and rivalry, supply a touch of humor now and then, and 
swing the class as a whole into a united effort where not only 
the class as a whole, but each individual in it, shall be in rap- 
port with the examiner and stimulated to do his utmost. 

The results of the effort to meet the third requirement, of 
convenience and economy of time in both practical work and 
research, may be more briefly indicated. The clerical labor 
of the child in taking the examination is slight ; only three tests 
call for much writing, and then only for single words, mostly 
monosyllables. Each item on each test can be scored as un- 
equivocally right or wrong ; the scoring is easy and of a routine 
nature. The writers use a stencil, which is placed over the 
blank, in scoring. The stencil has openings through which the 
child’s answers appear, with the correct answer written beside 
the opening on the stencil. With this device it is possible 
for a good stenographer to score the entire record of one pupil 
in about two minutes. Finally, the total organization of the 
scale has been carefully considered with reference to con- 





7 This alternation is further of much interest, in that variations in 
performance under these two conditions give a measure of instability. 
The impulsive, nervous, high strung child (every clinical psycholo- 
gist is familiar with the type) does fairly well if the examiner keeps 
the test constantly before him by presenting it bit by bit, but wanders 
quickly to other matters if left by himself with a problem. A State- 
ment of “irregularity” gives a measure of this factor. See S. L. 
Pressey, Distinctive Features in Psychological Test Measurements 
Made upon Dementia Precox and Chronic Alcoholic Patients, Journal 
of Abnormal Psychology, vol. 12, 1917, pp. 130-139. 
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INDIANA UNIVERSITY 
MENTAL SURVEY — GROUP STUDY 
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II. Logical Selection. 


DOG: ears, collar, nose. 
Examples: BOOK: table, pages, shelf, printing. 
CHAIR: arm, cushion, legs, rockers, seat. 

. CAT—fur, house, milk, claws. 

. TREE—apples, branchiés, acorns, roots, flowers. 

. SPELLING—book, writing, pencil, words, margin, letters. 

. SCHOOL—blackboard, teacher, window, pen, bell, school-house, 

pupils. 

5. STORE—counter, clerk, cash register, advertisements, goods, 
boxes, stove. 

6. BUILDING—windows, wood, chimney, wall, shingle, roof, 
stairs, shed. 

7. DEBT—mortgage, creditor, money, lawyer, collector, debtor, 
bankruptcy. 

8. SICKNESS—lameness, death, weakness, hospital, nurse, dis- 
comfort, doctor. 

9. GOVERNMENT—capitol, consul, navy, freedom, King, senate, 

cannon, tax. 
FRIENDSHIP—adoration, liking, lover, obedience, imitation, 
helpfulness, worship, gir]. 
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III. Arithmetic. 


1 a 11 16 
Titi isscnebinieclal Tancqsstiiunbebenn 12 17 
3 ee a ae Bhs cdeldh tis deasiiness a 
ivegaitittnwticedbnenss Do vivetinsitesate 14 19 











IV. Opposites. 


PRESSEY AND PRESSEY 


Examples: poor—rich. 


tent eee e eee eee eee eenneenee 


POOCNAVPwON Er 


_ 


steereeereceseeecesesess = = Weseereecceseceseceeecece 
seeeceseceeeeerecesesees Drevevecerecenscesseeseee 
ote nee neneneneeeeeeerees 


VI. Word Completion. 
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a....it....me....ic 


SOOMDIDM 


_ 


q 
§ 
’ 
: 





SRE a Ee 





. from 


. top 


- apart 

. less 

. never 

. bless 

- country 
- past 

. motion 


. if 


11. 
12. 
13. 
14. 
15. 
16. 
17. 
18. 
19. 
‘20. 
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VII. Moral Classification. Examples: marking, desks, giving, 
/ 


smoking, beiging. 


Whispering, stealing, charity, drunkenness, passing notes, kindness, 
sickness, gambling, tardiness, friendliness, extravagance, swindling, 
being noisy, benevolence, disobedience, forgery, justice, dissipation, 
graft, gluttony. 


VIII. Dissected Sentences. Examples: See aI man. 


WONHNPwWHy 





knife the sharp is 
cat dogs the after ran 
two 


. the cat see. 


trees pine tall are. 


. boy was the sick. 
. I not do to like go school to. 


me give my straw hat. 


. all know big boys how skate to. 

. their soldiers for fight country. 

. in the he brightest is boy class our. 

. teacher me gave a pencil my. 

. brother is my than I older. 

. asked me way I girl the to show the. 

. boy stone the who threw ran the fence the behind. 

. dash brother broke for my the yard fifty record the. 

. man whom the saw is you uncle my. 

. Tiver the John to swim tried was straight but across carried down- 


stream. 


. the boy in is class only our old youngest ten years. 

. you me to direct office of will the principal the? 

. watch the man stole is jail who the in. 

. who the sing during birds so summer the flown the sweetly to 


have south. 


. boy gold who highest watch which beautiful prize jumps the get 


the will is a. 
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IX. Practical Information. Examples: 


man train 
cow mule 
hen X horse 
dog bicycle 
cat steamboat 
1. 2. 3. 4. 5. 
water ing milk the handke F re) 
te 
cork steel bread baseball Memorial Day 
sand glass fish hide and seek iving Day 
iron pencil méat checkers Labor Day 
6 7. 8. 9 10. 
scissors i bill small pox weaver 
chisel ~~ coins euniet fever cabinet-maker 
plane senator check riveter 
saw mayor draft tuberculosis — typesetter 
knife representative stamps diphtheria coal-picker 
X. Analogies. 
girl—woman: bey—man 
Examples: sun—day: moon.............................. 
good—bad: big.....................cccceee 
1. woman—girl: man.................. 11. hill—valley: high................... 
2. kitten—cat: puppy.................. 12. arm—elbow: leg...............:.. 
3. sky—bluie: grass...................... 13. truth—falsehood: — 
4. fire—warm: snow.................... iti tectctlnactcratbitienicionss 
5. winter—autumn: summer. 14. like—friend: hate.................... 
6. horse—trot: fish...................... 15. teach—learn: teacher 
7. long—short: thick.................... 16. known—unknown: past........ 
8. train—land: boat.................... 17. little—small: ancient 
9. oyster—shell: banana.............. 18. water—pipe: electricity.......... 
10. mother—daughter: father...... 19. age—youth: autumn.............. 
20. failure—laziness: success........ 
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venience in dealing with data. There are ten tests, each one 
contains twenty iterhs, or points. The value of this plan—for 
tabulation, or analytical study by test, is obvious. 


II. Tue Tests 


Further details as to the exact nature of the examination 
can best be gathered from the facsimile blank and folder of 
directions given below. 


General Technique 


The examination ordinarily takes 45 minutes, but with 
third grade children it may run over an hour. Part of the 
extra time with the younger children goes into supervising the 
writing of name of teacher and school, date, and so on. With 
young children it is also necessary to make clear, by holding 
up a sample blank and pointing to the place, where each test 
is to be answered. But most of the time is spent in making 
certain that the examples are understood. It has been found 
most satisfactory to permit no questioning on the part of the 
children except on the examples, nor should there be any repe- 
titions of directions except in explaining the examples, which 
should not be left till the class shows a unanimous under- 
standing of them. 

The directions (except, as just mentioned, in making clear 
the examples) should be given verbatim as printed. The 
words of the rote memory test should be read at a rate of 
about two words per second. The exact time consumed by 
each individual item of the arithmetic, logical memory, and 
practical information tests cannot be given. It has been in- 
tended that these should be “ work-limit ” rather than “ time- 
limit.” tests, that time should be given for all except the very 
slow pupils to do all they can do. The examiner should, 
therefore, watch his class, and be careful not to travel too 
fast for the children. When working with the younger pupils 
the extra time they require in writing must be allowed for. 
Some evidence of the way the timing of these tests has been 
handled by the writers may be gained from the fact that the 
times have run from three to five minutes each for the rote 
memory and practical information tests, and six to eight min- 
utes for the arithmetic test, with two minutes for the ques- 
tions of logical memory. With third grade children the last 
five arithmetic problems may be omitted. For all others the 
tests should be given entire, whatever the grade. 
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Directions to Pupils 


All write your name please at the top of the page wherg it says 
“name”, and your age where it says “age”, then your birthday— 
month and day of the month—then your grade. On the second line 
write the name of your teacher where it says “ teacher”, then the name 
of the school (district, if country), place, (city or township), and the 
state, (Indiana). On the third line write the date (give date). 

Now I am going to give you some tests. Please do your best, do 
your own work, and do not pay any attention to what those around you 
are doing. 


I. Rote Memory 


Just below where you have been writing are twenty empty lines, 
Do you all see them? (Show place on blank). I am going to read 
you some lists of words, so listen very carefully as I shall read each 
one but once. Do not write while I am reading; wait till I get through 
and then write the word I tell you to write. 

1. This is the first list of words: hat, boy. Write on the first line 
the word that came after hat. 

2. This is the second list: mouse, chair. Write on the second line 
the word that came after mouse. 

3. This is the third list: cat, baby, cow. Write on the third line the 
word that came after baby, etc., for each line. (Repeat statement for 
each of the core gs J lists.) ; 

4. paper, watch, ink. 

5. horse, stone, window. 


This is the sixth list: Write the answer to this question on the 
sixth line. 

6. ground, milk, desk, hand. 

7. lamp, kitten, tree, girl. 

8. ruler, clock, table, box. 

g. street, glass, cloud, shelf. 

10. spoon, print, red, milk, green. 


This is the eleventh list: Write the answer to this question on 
the eleventh line. 

11. chalk, man, bag, book, sister. 

12. mother, chair, think, best, rain. 

13. run, dark, hard, pen, flower. 

14. ball, shoes, sleep, sick, bright. 

rs. light, past, bed, dog, match, coat. 


This is the sixteenth list: Write the answer to this question on 
the sixteenth line. 

16. swim, dull, plow, sky, ship, dress. 

17. ring, foot, jump, snow, flat, child. 

18. point, noise, cook, river, dead, long. 

19. pencil, quick, house, hill, run, store. 

20. grass, rain, woman, cloth, see, true, warm. 


II. Logical Selection. (Time 3 minutes.) 


Just below where you have been writing are some words in big 
letters. Each one is followed by a list of other words in small letters. 
Look at the examples: the first word in big letters is “dog.” What two 
things in the list following is a dog never without? (Have class 
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give answer)........ Those two words are underlined. Look at the 
second example. What two things in the list following “book” is 
a book never without? (Class answers question)........ Put a line 


under each of these words, just as there is a line under “ears” and 
under “nose” in the first example. Now look at the third example. 
What two things in the list following “chair” is a chair never with- 
ig eepeee: Put a line under each of these two words, just as you 
put a line under “ pages” and under “ printing” in the second example. 
Now hold up your pencils like this so you will all start together. In 
each of the ten lists, just below, put lines under the two words which 
the word in large letters, at the head of the list, is never without, 
exactly as you put lines under “pages” and “printing” and “legs” 
and “seat” in the two examples. And one thing more: do not under- 
line more than two words in any list. 


III. Arithmetic. 


Just below where you have been working you will see a number of 
lines numbered from 1 to 20. On these lines I want you to write the 
answers to the questions I am going to read. Do the questions in 
your head. If you miss an answer leave the line blank. 


1. On the first line write the answer to this question: If you had 
5 eggs, and broke two, how many would you have left? 

2. On the second line write the answer to this question: If you 
had 10 apples, and gave 1 to your mother and 1 to your father, how 
many would you have left? 

3. If you had 25 marbles and lost 4, how many would you have left? 

4. If you had 25 sticks of candy, and you gave 5 to your sister and 
6 to your brother, how many would you have left? 

5. If you had 25 rabbits, and 4 of them were killed and 8 more ran 
away, how many would be left? 

On the sixth line write the answer to this question: 

6. If you had 25¢ and bought 5 papers at 2c each, how much would 
you have left? 

7. If you had 15c and bought three blocks of paper at 3c each, how 
much would you have left? 

8. If you had 25c and you bought two handkerchiefs at 10c each, 
and a pad of paper at 3c, how much would you have left? 

9. If you had 25c, and you bought 2 erasers at 3c each and a bottle 
of ink at 5c, how much would you have left? 

10. If you had 50c, and bought a half dozen eggs at 60c a dozen, 
how much would you have left? 

On the eleventh line write the answer to this question: 

11. If your father gave you 30c, and your mother gave you % as 
much, and you spent a third of what you had in all, how much would 
you spend? 

12. If you could walk a mile in 20 minutes, how many miles could 
you walk in 2 hours and a half? 

13. If you spent 5c a day for a week, and then spent twice as 
much each day of the next week, how much would you spend in all? 

14. If you had 30 books, and you gave away one-third of them and 
then lost 3, how many would you have left? 

15. If you rode 5 miles and a half in a taxi cab, at 50c a mile, how 
much money would you spend? 

On the sixteenth line write the answer to this question: 

16. If you had a dollar, and you went down town spending 5c on 
the way down, and twice as much on the way back, and bought 2c 

5 
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stamps for twelve letters while you were there, how much would 
you have left? 

17. If you bought 3% Ib. of sugar at roc a lb. and a gallon of 
milk at 12c a qt., how much would you spent? 

18. If you could copy a list of 100 words in 5 minutes, how many 
words could you copy if you worked 40 minutes a day for 4 days? 

19. If you had 5o0c and you bought 5 pints of milk at 12c a qt. a 
half lb. of candy at toc a lb. and a loaf of bread at oc, how much 
would you have left? 

20. Suppose your family has to have 5 loaves of bread each week. 
If bread should go up from 7c to 10c a loaf how much less butter, at 


30c a lb. would you have to use, and still pay the same for butter 
and bread? 


IV. Opposites. (Time 3 minutes.) 


Turn over the page; at the top of the page there is a list of 20 
words, with a blank line at the side of each one. Look at the first 
example, the word is “ poor.” What is the opposite of “ poor;” if you 


are not poor, what are you? (Have the class answer)........Look at 
the second example, the word is “quick.” If you are not quick what 
are you? (Class answers question)........ Write the word “slow” 


on the line beside “ quick,” because slow is the opposite of quick. Look 
at the third example, the word is “hot.” What is the opposite of 
hot? (Class answers question)........ Write the word “cold” on 
the line beside “ hot,” because cold is the opposite of hot. Now write 
the opposites of all the other words in this list on the lines beside 
them. On the line numbered 1 write the opposite of “bad,” on the 
line numbered 2 write the opposite of short, and so on for the twenty 
words. If you come to one you do not know, skip it and go on. 


V. Logical Memory. 


This time, put your pencils down. I am going to read you a news- 
paper article and I want you to listen very carefully, for I shall read 
it only once and then shall ask you several questions about it. You , 
are to write the answers to the questions on the twenty empty lines 
just below where you have been working. This is the article: 

“East Chicago, January 17. A fire on Washington Street, early 
this morning, destroyed Smith’s grocery store, a barn and two dwelling 
houses near. The loss was about $12,000 and was partly covered 
by insurance. Six gallons of kerosene in the rear of the store burned 
fiercely, and made the fire hard to put out, because throwing on 
water only spread the flames. Mr. Smith lived over the store with 
his wife, two sons, and a daughter. The youngest, Mary, five years 
old, was made unconscious by the smoke and was rescued by a 
neighbor with some difficulty. The younger son, Harry, seven years 
old, helped his father in removing some of the goods from the 
burning store. Sparks, carried by a strong west wind, spread the 
fire to the adjoining buildings. Some think the fire was accidental, 
but the cash drawer was found open and empty, so the fire was 
probably set to conceal a robbery.” 

Now answer these questions with just one word—yes or no, or a 


— or a number. Write the answer to this question on the first 
ine: 


1. Were the buildings insured? 
2. Was the oldest child overcome by smoke? 
3. Was she rescued by her father? 
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4. How many children were there in all? 

5. Was Harry five or ten years old? 

Write the answer to this question on the sixth line: 

6. How many dwelling houses were burned? 

7. Was the kerosene the cause of the fire? 

8. How many gallons of kerosene were there? 

9. Was the wind blowing from the north? 

10. What was the youngest child’s name? 

Write the answer to this question on the eleventh line: 
11. Did Mr. Smith live in one of the adjoining houses? 
12. Was the fire in the summer time? 

13. Was Mrs. Smith badly burned? 

14. On what street was the store? 

15. On what day of the month did the fire take place? 
Write the answer to this question on the sixteenth line: 
16. Did the fire burn three or five buildings? 

17. How great was the loss? 

18. What part of Chicago was the fire in? 

19. How much money was found in the cash drawer? 
20. Did the fire burn down a drug store? 


VI. Word Completion. (Time 3 minutes.) 


At the bottom of the page you will see a list of words: wherever 
you see a line in these twenty words it means that a letter has been 
left out. And I want you to fill in these letters. Now all start. 


VII. Moral Classification. (Time 1 minute for each group.) 

At the very top of the next page you will see three lines of words; 
look at the examples. They read “marking desks, giving, smoking, 
begging.” Do you all see them? What words of the examples mean 
something which you must not do in the school-room? (If “ smoking” 
is given by the class say: “ Why, you wouldn’t be likely to smoke in 
the school-room anyhow, would you?”) That word has a number “1” 
under it. What word in the example means being good to other 
people? (Class answers)........ Put a number “2” under that, in 
the same way that there is a number 1 under “marking desks” in 
the first example. What word in the example means something that 
will hurt yourself? (Class answers)........ Put a number “3” under 
that. What word in the example means getting something unfairly 
from some one else? (Class answers) 
under that. Now pencils up. 

1. Go through the list (it begins with “ whispering”) and put a num- 
ber “1” under each word which means something that it is w rong 
to do in the school- -room, in just the way that there is a number “1 
under “marking desks” in the example. 

2. Pencils up. Now go through the list again and put a number “2” 
under every word which means being good | to other people, in just 
the way that you put a number “2” under “giving” in the example. 
Aad one thing more, do not put more than one number under any 
wor 

3. Pencils up. Now go through the list a third time and put a 
number “3” under every word which means something which hurts 
yourself, is bad for yourself, just as you put a number “3” under 
‘smoking” in the example. And again, do not put more than one 
number under any word. 


4. Pencils up. Now go through the list a fourth time and put a 


‘ ” 


ey a Rei Put a number “4 
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number “4” under each word which means getting something un- 
fairly from some one else, in just the same way that you put a number 
“4” under “begging” in the example. ‘nd once more, do not put 
more than one number under any word. 


VIII, Dissected Sentences. (Time 5 minutes.) 


Now pencils up—all stop. Look at the examples just below where 
you have been working. The first example is “See a I man.” That 
does not make sense, does it?........ How should it réad? (Class 
answers)........ What should be the first word? (Class answers) 
ena That has a line under it. What should be the last word? 
(Class answers)........ That has two lines under it. Look at the 
second example. How should it read? (Class answers)........ What 
should be the first word? (Class answers)........ Put a line under 
it in just the way that there is a line under “I” in the first example. 
What should be the last word? Put two lines under that in just the 
way that there are two lines under “man” in the first example. Now 
look at the third example; what ought to be the first word if the 


sentence is to make sense? (Class answers)........ Put a line under 
it. What ought to be the last word if the sentence is to mean any- 
thing? (Class answers)........ Put two lines under that. You see 


the sentence should read “Two dogs ran after the cat.” Now go 
through the 20 sentences just below and in each one put one line 
under what should be the first word, and two lines under what should 
be the last word, if the sentence is to make sense, just as you put 
lines under “ the” and “ sharp,” and “two” and “ cat,” in the examples. 


IX. Practical Information. 


Turn over the page. At the top are two examples. The first one 
reads “man, cow, hen, dog, cat.” Of those five animals, which one 
usually lives the longest? (Class answers)........ That has a line 
under it. Which one usually lives the shortest time? (Class answers) 
dik wan That has a cross after it. Now look at the second example, 
“train, mule, horse, bicycle, steamboat.” Of those five, which goes 
fastest? (Class answers)........ Put a line under it, in just the way 
that there is a line under “man” in the first example. Which goes 
slowest? (Class answers)........ Put a cross after it, in just the 
way that there is a cross after “hen” in the first example. 

Now look at the list numbered 1. Put a line under the thing that 
is heaviest, and a cross after the thing that is lightest. 

Look at list number 2. Put a line under the thing it is hardest to 
break, and a cross after the thing it is easiest to break. 

Look at list number 3. Put a line under the thing that costs most, 
and a cross after the thing that costs least. 

Look at list 4. Put a line under the game that it takes most people 
to play, and a cross after the game that it takes fewest people to play. 

Look at list 5. Put a line under the holiday that comes nearest 
New Year’s and a cross after the holiday that comes nearest the 
middle of the year. 

Look at list 6. Put a line under the tool that is hardest te sharpen, 
and a cross after the tool that is easiest to sharpen. 

Next look at list 7. Put a line under the most important man and 
a cross after the least important man. 

Next look at list 8. Put a line under the safest way to send money, 


. and a cross after the least safe way. 
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Now list 9. Put a line under the disease that it takes longest to 
get well from and a cross after the disease one recovers from quickest. 

Now the last list. Put a line under the man who must have most 
skill, and a cross after the least skilled worker. 


X. Analogies. (Time 3 minutes.) 


Now the last test of all. The first example reads: girl-woman: 
boy-man. When a girl grows up, she is a woman: when a boy grows 
up, what is he? (Class answers)...... So “man” should be the fourth 
word for it finishes the meaning of the other three words. Look at 
the second example. It reads sun—day; moon—...... The sun shines 
during the day, and the moon—when? (Class answers)........ So 
“night” is the right word for it finishes the meaning of the other three 
words. All write “night” on the line after “moon.” Now look at the 
third example. It reads, good—bad; big—...... There is good and bad 
and big and ........ ? (Class answers.) So what word should be 
written after “big?” All of you write “little” (or “small”) after 
“big.” Now go through all the other twenty lists in just this way, 
writing on the line after each list the word you need to finish the mean- 
ing of the other three. If you come to a list you can’t do, skip it and 
go on. 

III. Resutts 

These group tests have been given to 1022 children in the 
Bloomington public schools; to about 500 pupils in one, two, 
and three room country schools; to 200 cases in the State 
School for Feebleminded Youth at Ft. Wayne; to a special 
class of 23 children possessing superior intelligence and to two 
control groups in Louisville, Ky.; to 178 colored children; to 
the entire school population at Jeffersonville, Indiana; 769 
cases ; to all school children below the 11th grade in Bedford, 
Indiana, 1009 cases; to the fifth grade pupils at Logansport, 
277 cases ; and to the sixth grade pupils at Richmond, Indiana, 
308 cases. The effort has been to obtain data from as great a 
variety of cases and localities as possible to give a wide basis for 
the study of the various sociological and educational problems 
mentioned above.* The writers have been particularly inter- 
ested in analysis by test, for race, sex, and environmental 
variations. 

The results of these special studies will be presented and 
discussed in later papers. The present article will give only 
norms by age and by grade, obtained from the 1022 Blooming- 
ton children, plus such other material from the further studies 
as is necessary for an interpretation of these results. The 
Bloomington norms are presented in Table I. 





§ The writers wish at the outset to express their obligations to the 
school officials and teachers, who have co-operated in the study, to 
Dr. George S. Bliss, Superintendent of the State School for Feeble- 
minded Youth, and to Miss Henrietta V. Race, in charge of 
the psychological work in the schools of Louisville, Ky. Without their 
co-operation and interest this study could not have been made. 
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TABLE I 
Group PoINT SCALE RESULTS FROM 1022 SCHOOL CHILDREN IN BLOOM- 
INGTON 
No. No. 
Age cases 10% M. 90% Grade cases 10% M. 9% 
. Fae: Bee 3 116 28 52 =i 
9 92 40 71 108 4 9 42 6 £94 
10 96 44 93 124 5 96 73 98 114 
ll 114 62 105 141 6 108 88 110 136 
is aa 82 116 148 7 i 1 tH we 
: Hee 9 i27 155 8 122 112 133 156 
14 133 101 ##4138~«164 | 133 127. 166 7 
15 104 111 149° 167 II 97 135 155 165 
16 89 129 152 169 Ill $2. 4k: ee aS 
17 80 129 152 169 IV 56 153 162 171 
986* 1022 





* Below eight and above seventeen, there were too few cases at each 
age to give a reliable norm. These cases have, therefore, been omitted 
from the statement of results by age, though of course included in the 
figures by grade. 


The all important question now arises as to the reliability of 
the scale, and the significance, sociological and educational, 
of the ratings; the prime advantage (for the psychologists) in 
a combination of a psychological and a sociological survey was 
expected to appear in the possibility of obtaining interpretations 
of the mental measurements in terms of a large mass of educa- 
tional and sociological data. From the data so far gathered 
the following facts have been selected as most pertinent to 
these questions. 


IV. THE VALIDATION OF THE SCALE 


An indication of the significance of these tentative norms 
has been obtained from the following five sources. 


1. The reliability of the group tests to indicate the ex- 
treme cases has been checked up by Binet examinations. 
Throughout the survey the Stanford-Binet scale has been used 
as the final basis for making a psychological diagnosis of 
feeble-mindedness. The use of the Binet scale has been most 
systematic in two Bloomington graded schoois. In these 
schools 21 cases were found with an I.Q. of 76 or belew, who 
had also been examined by the group scale. They averaged 
at the 4 percentile of their age by the group tests; the highest 
scores made by these cases were at the 8 percentile. In those — 
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two schools a total of 317 children had been given the group 
tests. Of these 68, or 22 per cent, were given Binet examina- 
tions in an effort to discover all low grade cases. Teachers’ 
estimates, age-grade status and group scale ratings were all 
used in selecting the cases to be examined by the Binet scale, 
and the writers feel that errors made by the group scale in 
the rating of the low grade cases should have been discovered 
if they had occurred. On the basis of these results, the writers 
have been using the 10 percentiles as a limit above which a 
search for mental defectives need not go. The comparative 
reliability of this method may be indicated by the fact that two 
cases with I.0.s below 70 were found which had not been 
included by their teachers in lists of the poorest fifth of the 
class. 

According to Terman the group of cases having 1.Q.’s 76 
or below constitutes 3 per cent of the total distribution of 
abilities. A similar effort was made to discover supernormal 
children, the group which, according to Terman, makes up the 
upper three per cent. The Binet work with these brilliant 
children was not so systematic as was the search for mental 
defectives. Group test scores are available, however, from 
30 children who gave an I. Q. rating of 125 or above. The 
average standing of this group as determined by the Group 
tests is roughly at the 98 percentile. For the eight-year-olds 
there were two, who fell below the upper ten percentile, one 
at the 51 percentile, the other at the 88 percentile. Above this 
age all are included at the 85 percentile or above. These 
children were all ten or younger; with older children the 
accuracy would probably be greater. 


2. The purpose of the county survey was to determine—not 
the number of children with an I.Q. below 70—but the number 
of mental defectives of institutional grade. The most direct 
way to obtain data giving an indication as to the reliability 
of the group scale for this purpose would, therefore, seem 
to be to survey with the Group Scale an institution for the 
feeble-minded. As part of all the standardization of the scale 
the writers, therefore, gave the tests to all the cases in the 
State Institution for Feeble-minded Youth sufficiently literate 
to take the examination. Similarly, not merely children with 
an I.Q. above 125, but superior children who had proven 
themselves capable of profiting by intensive special class 
treatment in a “ gifted” class were needed to give an indica- 
tion as to the reliability of the scale to select brilliant chil- 
dren. A class of brilliant children at Louisville were there- 
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fore examined.* The “School for Feeble-minded Youth” 
has 416 cases 18 years of age or below. Of these, only three 
were able to make a rating above the lowest ten percentile 
of the school children of the same ages. One of these three 
has a Stanford Binet I.Q. rating of 78, for the other two no 
Binet ratings are available. Only five show a group scale 
rating above the lower five percentile. The institutional cases, 
then, are clearly marked off from the group of school children. 
At the other extreme, the Louisville group of gifted children 
made scores averaging at the 98 percentile of the Bloomington 
norms. This is, therefore, also a distinct group which may 
readily be selected or differentiated by the group tests. 


3. The age-grade status of a child is, at least for all except 
the first grade or two, the most definite single statement which 
the school can give regarding his mental ability. The age- 

ade status has been worked out for all the children examined 

y the group scale in Bloomington, six to eight being con- 
sidered normal for the 1B grade, and so on up. The results 
on this point may again be summarized briefly by saying that 
the 143 retards in the ages from 10 through 16 average 70 
points lower on their group test score than the 124 accelerates 
of the same ages, or to put it another way, the differences 
average 55 per cent of the medians at each age. In the entire 
number of cases (986) from 8 through 16, there are only 10 
accelerates whose group test score was below the median for 
their age and only five retards whose score was above the 
median for their age. 


4. It has not been possible to obtain correlations of teachers’ 
estimates with the group scale ratings for all the children 
tested. Such correlations have, however, been worked out 
for the children in one grammar school in Bloomington and 
for all the sixth grade children in another system who were 
examined by the group scale. These rankings by the teachers 
were in both instances called for in the last month of school, 
after the teachers had had an entire school year in which 
to become acquainted with the children’s abilities. The corre- 
lation of group test rank with teachers’ rank, averages .65 
for the 131 children of the Bloomington graded schools, and 
for the 309 sixth grade children is 63 (Spearman “ foot 
rule ’’). - 


5. It might be argued from the last two paragraphs that the 
tests were rather tests-of achievement or of school ability 
than of general intelligence. Data of great interest m this 





® Henrietta V. Race, A Study of a Class of Children of Superior 
Intelligence, Journal of Educational Psychology, vol. 9, 1918, pp. 91-97. 
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connection have been obtained from two other school systems 
recently surveyed by the scale. In one 1009 children were 
examined, in the other 769, so that the results are adequate for 
comparative purposes. The three cities are largely similar 
in make-up of population; in all the stock is almost entirely 
native born, and with this large number of cases the averages 
would be expected to be about the same by age if the scale 
was a measure of general intelligence. But the school systems 
differ considerably. The results obtained by the group tests 
by age show an average difference for the medians of less than 
2 points in these cities, whereas the differences by grade 
average 13 points. If the tests were a measure of the results 
of schooling rather than general intelligence the norms would 
be more similar for the grades than the age. These last 
results, the writers feel, are a striking vindication of the tests 
as tests of general intelligence, and as largely free from the 
influence of special training. 


SUMMARY 


The paper may be summarized briefly as follows: 

1. The group point scale is an examination, composed of 
ten tests each of twenty items, each test being applicable from 
the third grade through high school, or from eight to about 
sixteen years. 


2. The examination is especially adapted, in the nature of 
the individual tests, the variety of the tests, and particularly 
in the close relationship and co-operation between examiner 
and class, for work with grade school children. It gives a 
much more adequate mental rating for such children than a 
more artificial and set examination could give. 

3. The examination is carefully planned, in both detail and 
organization, for convenience in practical work and in research. 

4. The ratings obtained show, when correlated with other 
independent sociological and educational evidence, a high 
degree of reliability as measures of general intelligence. 











THE VALUE OF RELEVANCY IN ADVERTISEMENT 
ILLUSTRATIONS’ 


By Hersert R. Lastetr, University of Kansas 


If relevancy be defined as the portrayal (in the illustration 
of the advertisement) of the ultimate usefulness of the article 
advertised, how closely should relevancy be adhered to in 
the average non-trade, non-professional magazine? This 
paper contains the data obtained in an effort to answer scien- 
tifically this question. 

Objectively this question is of importance because it bears 
upon the construction of advertisements to the end that they 
may be brought to a high standard of efficiency (which means 
that they are economical in terms of money expended and 
money received resultant from an original outlay), and it is 
of importance therefore to the advertiser, the publisher, and 
the reader. Subjectively this matter bears upon the average 
amount of subject-matter retained out of the advertising 
aggregate seen by the reader of these so-called popular 
magazines. 

Psychologically it bears relation to the number of steps of 
progressive thinking that the average reader will make, or to 
the duration of the effort that he will make, to connect an 
article as shown in a magazine advertisement with himself ; 
or, in other words, relevancy in illustrations is closely related 
to the pulling power of an advertisement. 

In making these tests the main dependence for material 
was placed upon two copies of the Saturday Evening Post,— 
one of the issue of December 2, 1916 and the other of the issue 
of March 24, 1917. The bindings of these magazines were 
cut, and full-page advertisements selected from other issues 
were inserted in their proper page places, that is, the selected 
advertisement was inserted after page 64 of the test magazine 
if it was numbered 65 in the magazine from which it was 
taken. In this way no cue to the insertion of any pages was 
given to the subjects. It is needless to say that the inserted 
advertisements were chosen because they were clearly relevant 
or irrelevant, as the case may be. The pages of the new maga- 
zines were then fastened together with heavy spring-clips. 





1From the Psychological Laboratory, University of Kansas. 
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The advertisements with relevant illustrations that were 
chosen as test advertisements showed the article that they 
represented in actual use by some one evidently of the same 
habits as the majority of the people who would see the adver- 
tisement ; for example, the young man in the Pullman car dry- 
ing his hands on a Scottissue towel, or the Black Cat stockings 
that looked to be sound and durable in spite of the hard usage 
given them by the healthy youngsters on their roller skates. 
The other kind may be illustrated by such examples as the 
Gold Medal Flour advertisement showing a clown balancing 
upon his nose a rectangular object that proved, after some 
study, to be a baking pan, and beneath it the words ‘A Well 
Balanced Baking,’ or the Encyclopedia Brittanica advertise- 
ment showing the setting sun surmounted by the words “ after 
7:30 June 3rd.” The text that followed this illustration 
showed eventually that after June 3rd the encyclopedia could 
be bought only for a sum that was a large increase over the 
price for which it was then selling. The advertisements 
selected for one magazine were: 


1 Society Brand Clothes, March 24, 1917. 

2 Lyon’s Tooth Powder, same issue. 

3 Westinghouse Fans, July 8, 1916. 

4 Scottissue Towels, May 27, 1916. 

5 Goodyearite Packing, May 27, 1916. 

6 Certainteed Roofing, September 2, 1916. 

7 Wagner Products, June 17, 1916. 

8 Holeproof Hosiery, September 4, 1915. 

9 Textan Shoe Soles (Goodrich Co.), March 24, 1917. 
10 Stewart Auto Products, January 29, 1916. 

11 Neolin Shoe Soles (Goodyear), January 29, 1916. 
12 Kellogg’s Corn Flakes, February 5, 1916. 

13 Black Cat Hosiery, August 26, 1916. 

14 Stetson Hats, March 24, 1917. 

15 Main Belting Co., June 24, 1916. 

16 Stewart Warning Signals, June 17, 1916. 

17 Florence Oil Stoves, April 22, 1916. 

18 Goodyear Rubber Products, January 29, 1916. 

19 Encyclopedia Brit. (Sears, Roebuck & Co.), June 3, 1916. 
20 Ralston Wheat Foods, March 24, 1917. 
21 Hammermill Bond Paper Co., March 24, 1917. 

22 Maytag Washer Co., March 24, 1917. 

23 Gold Medal Flour, March 24, 1917. 

24 Gordon Seat Covers. 

25 Pullman Company. 
26 Beaverboard Wall Covering. 
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Students, mostly of the sophomore class, of the University 
of Kansas were used as subjects; they were members of the 
elementary psychology laboratory classes, but were unac- 
quainted with the purpose of the experiment. The Pleasant 
Hour Club—a group of farm women—was also used for the 
sake of studying the correlation between their interests and 
those of the students in order that the value of students as 
subjects for experiments in advertising might be estimated. 

In addition, series of advertisements of Packer’s Tar Soap, 
Fairy Soap, and Nujol were used upon various subjects, both 
in and out of University circles. They were asked to arrange 
these advertisements in the order of their preferability and 
attractiveness and then to state, as far as they were able to 
do so, their reasons for arranging them in a given order. The 
only requirement made in the selection of these people was 
that they be unversed in the problems of advertising. Their 
observations of the meanings of some of the irrelevant adver- 
tisements are given later. Their arrangements of the adver- 
tisements in the order of preferability coincided with the 
arrangement for relevancy to the extent that 60 per cent of 
the advertisements placed in the upper half according to their 
relevancy were also in the upper half according to their 
preferability. The exceptions were the ‘human interest’ pic- 
tures of the Fairy Soap, to which in an indirect way a certain 
amount of relevancy may be attached. 

The following method was used in the laboratory: the maga- 
zine was given to the various members of the classes as they 
were found in the laboratory working in pairs. The instruc- 
tions given to them were that they should have from five to 
seven minutes to look at the magazine as a whole, that they 
were not to read the stories, that they were not to talk over 
the magazine in the laboratory nor later outside of the labora- 
tory, and that for the time being they were to give their whole 
attention to the magazine. It was thought that in this way the 
ordinary conditions under which magazines are read by the 
average reader could be most nearly duplicated. On the 
second day after the first review of the magazine, it was again 
given to them to look over as before. On the fifth day after 
the second review (the next current laboratory period) these 
students were assembled in the classroom and each given a 
paper upon which to record, in the first place, the names of 
all of the advertisements which they could remember. The 
directions given at this time were that there should be no 
talking nor assistance to each other, that the article advertised, 
as gum, together with the trade name, e.g., Spearmint, were to 
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be written whenever possible. (Spearmint Gum was not in 
the advertisements included in the magazines.) In the second 
place those cases were to be mentioned in which either the 
trade name, as Standard Oil Company, or the article advertised 
together with enough description of the advertisement could 
be given to make the identification of the advertisement pos- 
sible. The more definite recollections given in the first place 
were treated separately from the less definite ones given in the 
second place. The recollections of the relevant and irrelevant 
advertisements were recorded in separate tables. 

Practically the same plan was used with the members of the 
Pleasant Hour Club,.except that they saw the magazine but 
once and wrote down immediately the advertisements remem- 
bered. 


The results with Magazine ‘A’ from the seven sections of 


TABLE I 

~~ Advertisements (Magazine A) Ist Class 2nd Class? 
ML Gis Oh cul aleie sc encase oe vs 10 0 
Figin SESS dé. Se Gm bs v4 exw ee ban’ 26 8 
Simmon’s Watch Chains................ 15 11 (a) 
Re spires ise. «0.0 k.vb'e «6 44 4 
BS ECCT 17 5 
PN EUG. Coote ccc cecccc cece 9 4 (b) 
ES i8 

ON ah os pidik Sidi ack wo ew ees 20.0 6.1 

Irrelevant Advertisements Ist Class 2nd Class 
Brascolite. . 1 1 (c) 
Cadillac. . 10 0 
Encyclopedia Brit.. 7 2 
Hoosier Kitchen Cabinet. . 5 1 
Main Belt Company................... 0 2 
Manuola Player Company.............. 1 0 
Maytag Washer Somme . ES isk Gent 0 0 
Perfection Auto Heater. . SD Whe A 0 0 
Stewart Speedometer Co.. 6 2 
Southern California (Gen. Publicity)... 10 11 (d) 
U. S. Rubber Company. . 11 0 
Vim Motor Company.................. 21 0 
Saturday Evening Post Adv.. 4 0 (e) 

FS REIBER eco ges — og 5.8 1.7 





* Examples of descriptions of advertisements which are counted in 
Class 2 because of sufficient definiteness are the following: (a) “ A picture 
of Norma Talmadge and some other actor wearing wrist watch and watch 
chain;” (b) “ Electric sewing machine with woman sewing;” (c) “ Do 
patent laws protect ’—a lighting system; (d) “ See California,” “ rail- 
road rates to California,” “ California—motorists es ”. (e) “ Arthur 
Brisbane, the highest paid editor in the United States.” 











274 LASLETT 


students were combined, as there seemed to be no essential 
differences between them, and these are represented in Table I. 
The column headed “ Ist Class” gives the number of times 
that each advertisement was mentioned in the first place, and 
the column headed “2nd Class” shows how frequently each 
advertisement was mentioned in the second place. The corre- 
sponding results with Magazine B are shown in Table II. 


TABLE II 


Relevant Advertisements (Magazine B) lst Class 2nd Class 
Society Brand Clothes.................. 7 
Lyon’s Tooth Powder.................. 2 

estinghouse Fans..................... 15 
I Tn ee 1 
Holeproof Hosiery..................... 9 
aan ee seach abiR le kn 19 
On aera nae 
Pree Gir, GOS... 6. eos vice ee cee ces 


NrWOW 
“- 
w 
wa 


5 
3 
8 
I te ro ee ars. 3 
Hammermill Bond Paper............... 4 
ee Peer 5 
6.6 


| ssocnemeore 


_ 
oi 


Irrelevant Advertisements lst Class 2nd 


Ns eee eee 0 
Certainteed Roofing.................... 2 
ee ee 3 
Wagner Elec. Manufg.Co.............. 0 
Stewart Auto Products Co.............. 1 
Neolin Shoe Soles Co................... 8 
Main Belt Company Ee PES Se REO nea : 

4 

2 

6 


lass 


Stewart Warning Signals............... 
Goodyear Rubber Products.:........... 
eS eee 
Maytag Washer Company.............. 


NOFRrOrrrONN DA 


_e™ 
~- @ 
Swe 


2 
S 
: 
bo 
o 
bo 


TABLE III 
Relevant Advertisements (Magazine A) 


SIR OD ES. Sa Rime gay Sep Bee Nie «fs 
SE ME. bid ais S 5 0 F's 0:0 v an'v'e Cede bs 6 eee Cokes 
pS gS ONTENTS Ea aaa sy 87 
PE MC Ae Pny + 54 0} xRe bic dubin'e wa hs «tebe 
I as 0 » ars SubSids ah a die Soho A 
Western Elec, Sew. Mach. Co...................04.. 
NN ME svn nbc bia ness sc eu bs 0s Sue a cw hs 


NOMS Sr 
| own owe 
Oo 





* In these cases the advertisements in Magazine B are not the same as 
those shown in Magazine A. 
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TABLE IlI—Continued 











Relevant Advertisements (Mag ‘zine B) 


I IE IIL, 5 oo ois wd whe cudicdconchivnces, 
(a yg hil lA ea RE ce 


estinghouse Fans 


Holeproof Hosie 
Kellogg’s Corn F kes... 
Black Cat Hosiery. . 
Florence Oil Stoves. . 
Ralston Breakfast Food. . 
Stetson Hats. . 
Hammermill Bond Paper. 
Textan Shoe Soles. . 


Irrelevant Advertisements (Magazine A) 


SRIIS o 6 ssa 'c i alam’ \n 0 Goad 


Cadillac. . 

Encyclopedia Brit... 
Hoosier Kitchen Cabinet. . 
Main Belt Co.. , 
Manuola Player-piano. . 
Maytag Washer Co. 


pieging Water ©. «0. -----2-----es0 ene eeseeee. 


Sootiwemae POW. ............ 0008s 


Southern California (ad.)..................-....--. 


U. S. Rubber Co 


Vim Motor Company..............4...... 


FR es epee ee ee 


I BM ee OL a, tBiee KAKO had FOE Oe 


Irrelevant Advertisements (Magazine B) 


_ 


POON MMPS lor 


Certainteed Roofing. . 
Goodyearite Packing Co.. 
Stewart Auto Products. . 
Neolin Shoe Soles. . 

Main Belt Co.. 

Stewart Warning Signals. . 
Goodyear Rubber Co 


Becypetia Baka 00000022 


Maytag Washer Co.. 
Gold Medal Flour. . 


COME EP EODWWODD 





w 
ul 


KNmwOoCOCCONnNooo 





0.5 


Coonooonwnooo 





In the papers of the Pleasant Hour Club there were only 


recalls of the first class. 


The results are given in Table III. 


By converting the actual frequencies of the preceding tables 
into percentages we obtain the results as presented in Table LV. 
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TABLE IV 
Relevant Ist Class 2nd Class Total 
Magazine A with students................ 17 5.6 
Magazine B with students................ 9.8 2.9 
Magazine A with clubwomen.............. 33 — 
Magazine B with clubwomen.............. 58.2 — 
Ss i Uaioks ceeee s <> sus aehedeans 118. 8.5 126.5 
Irrelevant lst Class 2nd Class Total 
Magazine A with students................ 5.3 1 
Magazine B with students................ 3.6 1.9 
Magazine A with clubwomen.............. 0.8 — 
Magazine B with clubwomen. . hei 0.6 = 
arses ic 08 Kab ch Wah Ree a 10.3 2.9 13.2 


These results seem to allow of no doubt as to the com- 
parative value of relevancy in the magazine cuts as against 





TABLE V 

APPREHENSION TIMES Average 

Relevant Advertisements for 15 subjects 

5; ee en Ss eel. dd 9.3 seconds 
2: ech MI. i ea ss eink 6a eho 10.6 Hy 
3. as cs 5 Lack che én Wye bdmea 10.5 2 
Dy EG SiR dcksotels paiassoae sw cen's 8.1 ie 
5. Holep roof ME ooh nie Bane a Ahad Voces o 5.7 " 
6. Kalle s Corn Flakes... 6.8 ¥ 
7. Bates Hosiery. . 6.6 6 
a a age ea 7.7 ne 
eS ern nar ris 8.8 om 
BS REE ae) eae ae 4.9 x 
11 0 Et Pre oe 15.0 x: 
ee NG eR 11.6 . 
Dy: Re SS ee, vas cae c even 6.3 12 
14 EE het ba blo oe ws 4s.nee Vemhs 8.5 ve 
he co Clie. 0k «ass 6d v.40 eed 10.6 7 
IN Baas See's oad dv vou wae tena eee 8.73... “ 

Irrelevant Advertisements 
1. Certainteed ol an Ga Pa eakbte dd iis ened made 26.2 es 
2. Goodyear Packi 22.3 
3. Wagner Electric 34.2 x 
4. Stewart Products (auto)... fe EES Olen mie 22.2 a 
. Neolin ty, es re Sh es ss wy Ray ‘. 
. Main t Com rent ae ghee So's & 6 os b'O8 ? 
7. Stewart Wa ming Ske aaa | Fons wae a he 15.5 és, 
. Goodyear Rubbe ES icres be pa Xone ee a ; be 
. Ency MO eis Ss nee Meukcine ; 

10. Ma Sy ae es ke 16.5 se: 
Bis MEE UE ss Wa bec ks ooo nc viabeeenas Jie 22.1 o 
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irrelevancy in the illustrations, since nearly ten times as many 
advertisements with relevant illustrations are recalled as those 
containing irrelevant illustrations. 

As a check upon the validity of the selection of the adver- 
tisements as relevant or irrelevant, the advertisements of 
Magazine B containing both the relevant and irrelevant 
illustrations were used with a group of fifteen students who 
were unfamiliar with the tests, and the apprehension-times of 
these subjects were taken for each advertisement. Appre- 
hension-time was considered the shortest time-interval neces- 
sary to elapse in order for the subject to name the article 
advertised or the company advertising and one point of advan- 
tage or superiority of the article mentioned in the text of the 
advertisement or easily inferrable from it. Table V shows 
the results of this test. 

It will be seen that in only one case was the apprehension- 
time of an irrelevant advertisement less than the longest appre- 
hension-time of a relevant advertisement, and thus the selec- 
tion of the advertisements as easy or difficult of understand- 
ing was verified in all cases except this one of the Neolin 
Shoe Soles. A partial explanation of the short time of this 
advertisement may be the fact that it came after the adver- 
tisement of Textan shoe soles more often than not and thus 
attention directed to composition soles was carried over from 
the latter to the former advertisement. 

Taking up some of the minor phases of the experiment we 
may .consider the position of the selected advertisements 
within the magazines, the relative frequency of the advertise- 
ments, the intensity of the advertisements used, and the occur- 
rence of advertisements by the same firm in both magazines. 

In the matter of favorable and unfavorable positions, one 
of the advertisements was placed immediately preceding the 
reading matter . . . presumably the best position in the 
magazine . . . and another was on the back cover. Both 
were within the median percentiles of number of recalls. The 
other advertisements were scattered through the advertising 
sections and varied in number of recall apparently without 
regard to their positions in the sections. 

As regards frequency of appearance of the advertisements, 
the more common advertisements were not used in our tests. 
So far as is known to the writer none of the selected adver- 
tisements appeared in the magazines commonly read by stu- 
dents during the week of the experiment or the week pre- 
ceding it, except that a few of the test advertisements were 
selected from the original issue of the magazine used. The 
advertisements selected were as nearly equal in frequency as 


6 




















278 LASLETT 


possible. It is believed now, however, that one reason for 
the high number of recalls received by the Velvet tobacco 
advertisement is its relatively greater frequency of appearance, 
and the credit it gains from the advertising of similar products, 
such as Prince Albert and Tuxedo. 

The intensities of the contrasts of the cuts were as nearly 
the same as it seemed possible to choose them, with the 
exception of the irrelevant advertisement of the Vim Motor 
Company in Magazine A. This advertisement was recalled 
22 times out of a total of 76, or almost one-third of all the 
cases. It is needless to say that the intensity of this adver- 
tisement seemed to be greater than that of the other advertise- 
ments. As none of these were favored to a similar degree, 
it would seem that their intensities were nearly equal. 

In the matter of placing two advertisements of the same 
firm in both magazines, there was no notable increase in the 
number of recalls of the second advertisement over the first. 
This is significant because it leads to the conclusion that no 
matter how frequently an advertisement is inserted, if it 
has little’ attention value, no benefit will be gained from the 
second or third insertion if it is not noticed in the first. 

In regard to the subjects used, students were used because 
they were available in the greatest numbers and were as good 
subjects as could be obtained. The women of the Pleasant 
Hour Club were used because it has been found that the 
women do more than half of the family buying, and the 
articles advertised in the Saturday Evening Post and other 
popular magazines are of the sort where the influence of 
women would be keenly felt. 

In listing the apprehension-times it was evident from the 
first that students turned much more readily to the adver- 
tisements whose general subject matter was in some degree 
familiar to them, thus evidencing the inertia of attention 


, that advertisements must overcome. 


Among the advertisements mentioned by the students were 
some not found in the magazines. Phoenix Hosiery was 
mentioned six times because it was mistaken for the Hole- 
proof advertisement. Old Dutch Cleanser was mentioned 
presumably because its advertisements are nearly always in 
the Saturday Evening Post. Ivory Soap was mentioned three 
times for probably the same reason. Big Ben clocks, Prince 
Albert tobacco, Royal Tailoring Company, and Overland cars 
were likewise mentioned by mistake, as they were not found 
in the test magazines: this is perhaps due to the constant 
advertising of these concerns. 
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To summarize our results: it was found that advertise- 
ments containing relevant illustrations were remembered 
nearly ten times as often as advertisements with irrelevant 
cuts. In the case of the former kind, the name of the 
firm or of the article advertised together with one point of 
the latter’s superiority was apprehended from two to three 
times as quickly as in the case of the irrelevant illustrations. 
The employment of university students as subjects in psy- 
chological tests on advertising is justified, since no significant 
difference was found between them and a class of women 
who represent the purchasing public. Other well-known facts 
of the psychology of advertising, such as the influence of the 
size of advertisements, of the frequency of their appearance, 
of the intensity contrast of their illustrations, of the sur- 
rounding reading-matter, and the like, were .confirmed by 
our results. 










































FURTHER COMMUNICATIONS REGARDING “A 
PLAN FOR THE TECHNICAL TRAINING 
OF CONSULTING PSYCHOLOGISTS ” 


Dr. Leta S. Hollingworth, Teachers College, Columbia Uni- 
versity, sends the following: 


TENTATIVE SUGGESTIONS FOR THE CERTIFICATION OF 
PRACTICING PSYCHOLOGISTS 


It is with pleasure that I accept the invitation of The 
Journal of Applied Psychology to participate in the sym- 
posium on qualifications for psychological experts. Since 
my own practical experience has been very largely in the so- 
called clinical field, 1 do not doubt that what I have to say 
will be conditioned to a great extent by that experience. 

In the first place, there is distinction among the various 
fields in which psychologists serve, in spite of the fact that 
there is much overlapping among these fields. We have 
educational psychology, industrial psychology, clinical (med- 
ical) psychology, etc. Not only are these various fields to 
be distinguished, but upon reflection it becomes clear that they 
are at the present moment in different stages of development, 
both in regard to the preparation obtainable in the universities, 
and in regard to the actual demand for services to be rendered. 

It is my impression that so-called clinical psychology is 
more advanced in many respects than are the others. Edu- 
cational psychology, though well established, has devoted itself 
to teacher-training, rather than to the development of the 
expert educational psychologist; so that the latter (insofar 
as he can be differentiated from the clinical psychologist) is 


/among the most recent innovations. Industrial psychology 


can hardly be said to be taught as yet, even in first rate 
university departments (Carnegie Institute for Technology 
being a notable exception). On the other hand, preparation 
for clinical psychology is now being offered in several of the 
large universities; the demand for psychologists in this field 
is steady and increasing; a national association of those 
already in the field has been formed; and some of the states 
have even set legal standards for the practice of clinical 
psychology. 

This inequality of development in the various branches 
of applied psychology complicates the matter of certification 
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of individuals. Certification in the clinical field seems feasible 
and necessary at this time, whereas certification in the indus- 
trial field seems impracticable. 

In the present state of affairs, it seems to me that the most 
workable plan is to certify institutions. Let there be a stand- 
ing committee of a responsible body, such as The American 
Psychological Association, to prepare a list of departments 
of psychology, where prescribed training has been made avail- 
able. This list should be published annually, and printed in 
the report of the A. P. A., and in the technical journals, and 
posted in departments of psychology. Then, for the imme- 
diate present, let the certified institutions certify individuals, 
by conferring upon qualified persons the prescribed diploma. 

In this there would, of course, be nothing legally manda- 
tory. Ultimately the legal certification of individuals must 
be brought about, but in my judgment this will not be prac- 
ticable until the courses of study have been standardized, 
and have actually been offered for three or four years at 
the universities. 

As to the various degrees of expertness, and the recogni- 
tion of each by means of a suitable diploma, Dr. Geissler 
in his initial article on the subject, distinguished three possible 
levels of skill. It seems to me that but one level of fitness 
should be certified, namely the fitness of an individual who 
will be an expert psychologist, with all the knowledge neces- 
sary (so far as knowledge is available) for the direction and 
control of human behavior. This person should earn and 
receive a doctor’s degree in psychology, and should be given 
a professional diploma as Psychologist. 

Many will hold that the grade of attainment represented 
by the master’s degree (a college course and one year of 
specialization beyond), should be distinguished and certified. 
At times it seems to me that this should be done, and that some 
such title as Assistant Psychologist should be conferred; yet 
the more closely I consider the question the more convincing 
seem to me the arguments against certifying an inferior grade 
of training. Will not such certification tend to create a 
supply of certified inferior and hence inexpensive service, the 
inferiority of which will be condoned in many quarters for 
the sake of the inexpensiveness? Will not the distinction 
between Psychologist and Assistant Psychologist be too vague 
to function, especially since one costs much more than the 
other? And will not the whole purpose of the attempt 
at standardization be thus frustrated? For, as I conceive 
it, the purpose of standardization is twofold, (a) to assure 
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the best possible quality of service to the public, and (b) to 
protect those who are able and willing to undertake thorough 
preparation against the competition of those who are unable ‘ 
or unwilling to undergo the same training. The accomplish- 
ment of the first purpose is inseparably bound up with the 
accomplishment of the second. 
It may be argued that the doctor’s degree in psychology 
is at present awarded largely on the basis of research, in our 
most completely equipped universities, and hence requires a 
higher type of intellectual capacity than is necessary for the 
average practitioner. To me it seems doubtful whether the 
average successful candidate for the doctor’s degree in psy- 
chology has more intellectual ability than should be required 
of one who aspires to be trusted with the direction and control 
of human behavior. It is at least doubtful that the average Ip 
ability of those who have won the doctorate in psychology 
during the decade just passed is higher than that of the gradu- 
ates of good professional schools, such as schools of medicine 
and schools of engineering. As fast as really good prospects 
are established in applied psychology, really good people will 
come to qualify—people who are fully capable of earning 
a doctor’s degree. But prospects in applied psychology will 
not be good, so long as persons of mediocre qualifications 
occupy the field. 
It has been suggested that the traditional divisions of 
academic training into that for the M. A. and that for the 
Ph. D. are not very fortunate for the present purposes. The ¢ 
Ph. D. is not in a strict sense a professional degree. There 
exists at present no degree to indicate the completion of a 
prescribed professional course in psychology, which does not 
t involve intensive research, but which does involve practice in 
) applications. It has occurred to me that perhaps the situa- 
tion calls for a new departure, the “invention” of a new 
degree,—Doctor of Psychology—which would involve six 
years of training, including college, with an additional ap- 
: prenticeship year (instead of research). I think this sug- 
gestion is worth considering, as the old Ph. D. is scarcely 
a appropriate to many of the modern uses it is made to sefve. 
Hi Sooner or later it ought to fall away from the sciences through 
: sheer weight of its irrelevancy. 
. 
; 








As I have often stated, I am convinced by personal experi- 
ence and by the experience of colleagues in the field, that 
Hy it will hardly be possible for applied psychologists to succeed 
Hk (in clinical practice at any rate), without the doctor’s degree. 

The reasons why this is so probably go back, in the last 
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analysis, to the fact that the doctor’s degree has come to 
signify adequate skill in him who presumes to direct human 
welfare. Thus competing professions can and do play in 
many subtle ways upon the lack of a professional title, to 
the detriment of the psychologist’s legitimate work and ser- 
vice. Furthermore, the general public is disinclined to accept 
the advice of one who lacks the title of doctor in his field. 
Thus the usefulness of the psychologist is materially im- 
paired, in cases where he is not qualified with the doctor’s 
degree. These are phases of social psychology which it is 
necessary to admit, in considering the matter of certification. 
To ignore them would be to betray ineptitude as an applied 
psychologist at the very outset. Either we can fall in with 
the social habit, or dedicate ourselves to a long and tedious 
process of reforming it. 

This emphasis upon the importance of formal titles, -cer- 
tificates, degrees, etc., does not, I find, impress the academic 
psychologists, who have not personally experienced the limi- 
tations upon usefulness resulting from the lack of a “ suit- 
able” title out in the practical field. Thus they are inclined 
to urge that certification is a relatively insignificant matter, 
and scarcely worthy of dignified discussion. It seems to 
them that the only really important consideration is that the 
instruction shall be of first rate quality. To them it is impor- 
tant that the professional teacher of psychology should have 
the doctor’s degree, but unimportant that the practical psy- 
chologist should have it. They feel, somehow, that it prob- 
ably requires less training and ability actually to direct and 
control human behavior, than to teach how to direct and 
control it. 

Here we see the difference in viewpoint between the pure 
scientist and the practitioner. This divergence is inevitable; 
and it is only to be expected that the majority of psychologists, 
whose interests are mainly in teaching and research, will not 
be much moved by the subject which we are here considering, 
i.e., certificates for practitioners. The adequate solution of 
the problem is, nevertheless, essential to the progress of prac- 
tical psychology. 

Summary of Suggestions 


1. Legal certification of individuals will ultimately be neces- 
sary, but for the immediate present is scarcely feasible, owing 
to the unstandardized condition of curricula, and the inequal- 
ity of development in the various branches of applied psy- 
chology. Standardization of curricula must precede legal 
certification of individuals. 
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2. For the present, institutions should be certified. Lists 
of certified institutions should be published. These institu- 
tions should be charged, for the time being, with the certifica- 
tion of individuals, by conferring upon qualified persons the 
prescribed diploma. 


3. Only one grade of professional qualifications should be 
recognized by formal certification: persons who earn the doc- 
tor’s degree, specializing in psychology as prescribed, should 
receive a professional diploma carrying the title, Psychologist. 


4. The suggestion is worth considering as to whether the 
situation does not call for an innovation,—the creation of a 
new professional degree, Doctor of Psychology. ; 


Professor S. C. Kohs, of Reed College, writes as follows: 


A Worp REGARDING PLANS FOR THE TRAINING OF 
PsyYCHOLOGISTS 


If psychological practice is to become a respectably estab- 
lished institution, then-the question of preparation and 
licensing of psychological practitioners becomes a matter of 
extreme importance. If the issue is dodged now, psychology 
will have to face it in some aggravated form later on. 

The American Medical Association has for years exercised 
careful scrunity over medical education in this country. This 
supervision has meant immeasurable benefit to the medical 
profession and to society. Practically every state specifies 
clearly the grade of the college, as assigned by the American 
Medical Association, from which prospective physicians may 
be accepted. Recently a national examining board was estab- 
lished and two national examinations have thus far been 
held. But these conditions have been the result of years of 
active and bitterly opposed propaganda. It seems reasonable 
to expect that the practice of psychology will pass through a 


/ somewhat similar evolution. But the American Psychological 


Association, profiting by the experience of the medical organ- 
ization, can attain the same influence in its field with a con- 
siderably smaller expenditure of effort if active measures are 
taken before quackery obtains a substantial foothold. There 
should be a standing committee of the American Psychological 
Association which should set standards of training for the 
various types and grades of applied psychology: clinical, edu- 
cational and vocational, and which should act as a national 
examining board, granting degrees or licenses to properly 
qualified individuals. I think it would prove unwise to 
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delegate this power to individual college or university depart- 
ments, as has been suggested. 

A symposium on this subject at the present time is most 
opportune. When the war is over psychology, together with 
all our other sciences, will be called upon to contribute its 
maximum toward social reconstruction. It must stand ready 
to perform this task respectably and with credit. 
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BOOK REVIEWS 


Ostas L. Scowarz. General Types of Superior Men. With a preface 
by Jack London, and an introductory letter by Max Nordau. 
Richard G. Badger, Boston, 1916, p. 435. 


The book contains ten chapters which may well be i into 
six divisions as follows: (1) Ch. I, Definition, General Characteristics 
of Genius and Talent; Ch. II, Origin and Conditions; (2) Ch. III, 
Types of Superior Men, Intellectual Hierarchy; (3) Ch. IV, Creative 
Life, Ch. V, Affective Life, Ch. VI, Striving Life; (4) Ch. VII, 
Influence upon the Masses; (5) Ch. VIII, Appreciation; (6) Ch. IX, 
Normality and Abnormality. 

In the first chapter the author gives a rather extensive characteriza- 
tion of the genius, the talented and the philistine individual. In this 
he points out the characteristic memory imitation, verbosity, im- 
pressionability, mental harmony, affection and volition which the 
genius possesses. In the treatment of the heredity and variability of 
the genius it becomes difficult for one, in the light of present biological 
principles, to accept some of the unique theories of the author. On 
page 85 he states: “To produce a genius, the qualitatively similar 
characters of the parents must be added algebraically; a geometrical 
addition gives birth to common mortals and talented men.” 

Chapter II shows the value to society of the philistine group, but 
the importance of the genius to society is kept in the foreground 
through the whole book. In connection with this some of the forces, 
as pain, poverty, etc., which aid or suppress the genius, are treated 
very well. The high intellectual status of the superior group is treated 
in more detail in chapter III. The fourth chapter, while termed “ The 
Creative Life,” is really a further elaboration of chapter I. Chapters 
V, VI, and VII deal with the affective and striving life and will be 
of interest to readers of Social Psychology. Chapter VII treats of 
the vital relation of the talented person to his social environment 
and his contribution to the group. The mutual relation between the 
individual and the group receives emphasis in chapter VIII. Chapter 
IX is somewhat apart from the rest of the book, although the general 
idea of the author is still apparent. It would not be impossible to 
omit this chapter, yet it will be of some interest to the general reader. 

The title of the book would be truer to the discussion with the 


jword “Superior” omitted, as all classes are treated, but emphasis 
‘is placed on the highest type of person, the genius. With this indi- 


vidual the author compares the talented man and the philistines, or 
average persons. This discussion is interesting in connection with 
McDougall’s élite group, and The Great Society of Wallas. “ Phil- 
istines differ from geniuses in both aims and abilities. The talented 
man differs from the genius belonging to the same class more in 
ability than in aims,” p. 16. The author has followed the literary 
style of Lombroso or Havelock Ellis. Quite often the linguistic 
style of the author attracts the attention away from the point, which 
he wishes to make. All references to works which he has undoubted! 
made use of are omitted. While the reader may not notice this lack 
of references, one cannot escape the feeling that some of the author’s 
statements without the signs of a quotation are really direct quota- 
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tions; p. 415-6, for example: “ Women as a rule are born philistines: 
to fall into their hands.” 

In many places the reader feels that the author did not make use 
of the most recent and accepted views in biology, sociology, and psy- 
chology. “. . . genius . . . can be regarded as a result of 
accumulation or summation of inherited unconscious tendencies, of 
inherited cosmical-suggestive impulses,” p. 84. “Only those acquired 
characters are transmitted | jhereditarily which affect strongly the 


parent’s organism, . p. 84. “In animals not only habits 
or acquired characters but also actions performed but a! may 
become instinctive or hereditary modes of behavior, . . a CER 


“We understand why for women, knowledge, or truth, is still a means 
to success, and has not yet become an end-in-itself,” p. 412. 

The author has crowded his statements full of ideas and his sen- 
tences almost resemble aphorisms. The book will be of interest to 
students of social psychology and sociology, and to the layman who 
wishes a popular treatment of the characteristics of the élite group 
in comparison with the philistine group. Jj. E. Evans. 


Lewis M. TerMAN, Grace LyMAN, GeorGE OrDAHL, Loutse ELLISON 
OrpAHL, Neva GALBRAETH and Witrorp Tavpert. The Stanford 
Revision and Extension of the Binet-Simon Scale for Measuring 
Intelligence. Educational Psychology Monographs No. 18. 
(Edited by Guy Montrose Whipple.) Warwick and York, Inc., 
Baltimore, 1917, p. 179. 


This monograph.summarizes the data on which is based Terman’s 
revision and extension of the Binet Scale as published in his Measure- 
ment of Intelligence. After a “ Brief Account of the Stanford Re- 
vision and its History” in chapter I the authors discuss in the sub- 
sequent seven chapters the following topics: “ The Distribution of 
Intelligence,” “The Rate of Growth and the Validity of the I. Q.,” 
“Sex Differences,” “The Relation of Intelligence to Social Status,” 
“The Relation of Intelligence to School Success,” “The Validity of 
the Individual Tests,” and “Some Considerations Relating to the 
Formation of an Intelligence Scale.” Among the reasons why the 
authors claim “that the Stanford 1914-1915 data have more than 
ordinary significance” are: the great number of children, namely 981, 
varying between 80 and 120 at each age from 6 to 14 years, with some- 
what fewer at 5 and 15, the great uniformity and care in the conduct 
and scoring of the tests, the selecting of children within two months 
of a birthday, and the elimination of racial differences. Consequently 
the distribution of intelligence for the ages separately as well as 
for combined ages as based upon the Intelligence Quotient follows 
very closely the theoretical (Gaussian) normal frequency curves. The 
curves show that the distribution of mental ages becomes progressively 
flattened the older the children. The authors believe that the results 
of tests repeated on the same children at various intervals as far as 
they have been made, “support in a general way the hypothesis that 
the intelligence quotient of a given child tends to remain constant ” 
and that “growth of intelligence comes to a standstill somewhere in 
the later years of adolescence and that the cessation is gradual rather 
than sudden.” The data on hand also throw doubt upon the common 
notion that mental development progresses alternately at slower and 
faster rates. A slight sex-difference in favor of the girls seems to 
occur between 5 and 14 years of age, and in certain tests sex-differences 
were unexpectedly well marked. “The median intelligence quotient 
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for children of the superior social class is about 7 points above, and 
that of the inferior social class about 7 points below the median 
intelligence quotient of the average social group.” The superiority 
seems to the authors to be “almost certainly due primarily to superior 
original endowment,” and they base this conclusion upon five supple- 
mentary lines of evidence which are fairly convincing. The resuits 
also show a very close agreement between the intelligence quotient 
and the quality of school work as judged by the teachers. The cases 
of disagreement are mostly due to the teacher’s oversight of age dif- 
ferences. As a consequence “superior children are seldom allowed 
to reap the advantages in school progress, to which their superiority 
fairly entitles them.” The authors point out that a given amount of 
retardation or acceleration is not equally significant at the different 
ages, which fact has been most consistently overlooked by many stu- 
dents of the problems of age-grade progress. The last two chapters 
are of especial importance from the standpoint of the theory of mental 
testing and intelligence scales. The three criteria for the validity 
of a test in an intelligence scale are said to be increase in per cent 
of unselected children that pass it, internal coherency, and reasonably 
high correlation with intelligence as otherwise estimated. Considering 
the second of these as the most important criterion, the authors have 
subjected it to an elaborate statistical treatment and on the basis of 
it have divided all the tests examined into good, poor and indifferent. 
Another statistical treatment of results from adults shows that there 
is no significant influence of school training on the ability to pass 
most of the tests. The influence of the age-factor is difficult to deter- 
mine, but the results on the tests involving memory were found to 
contradict those of Kuhlmann. The last chapter is a defense of the 
Binet method of testing intelligence against various critics, an exposi- s 
tion of his dynamic conception of intelligence, and a justification of 
the principles underlying Terman’s revision and extension. The last 
paragraph attempts to prove that the advantages claimed for the 
Yerkes Point-Scale are questionable, that it has failed to equalize 
the “points,” and that the employment of the intelligence quotient 
secures for the Binet Scale the advantages of giving partial credit 
for partial success. 

An appendix of 16 pages contains tables giving the percentages 
that passed each test at each age. These tables might have been made 
— valuable by stating in each case the number of subjects 
tested. 

No psychologist, whether favorably or unfavorably dispesed towards 
the methods of mentality testing, should fail to read this monograph, 
as it is by far the most important recent contribution to the problems 
of measuring intelligence. The topics treated are also of vital impor- 
tance to teachers and educational administrators, and a widespread 
familiarity with this monograph should prevent many misuses of 
mental tests by persons not sufficiently acquainted with their true 
nature and significance. me ES 








' Epwarp Starrorp Jones. The Influence of Age and Experience on 

Correlations Concerned with Mental Tests. Educational Psychol- 
ogy Monograph No. 22. (Edited by Guy Montrose Whipple.) 
Baltimore, Warwick & York, Inc., 1917, p. 89. 


Ni The avowed purpose of this monograph, as set forth by the author, 
ht is truly stupendous. It is an attempt to — answer to practically 
all those fundamental problems which confront the practical worker 
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in the field of mental testing. The author makes an assay at answer- 
ing the questions involved in the influence of age and experience on 
test performance, which answers, when correctly given, will tell us what 
in actuality the nature of potential development is, from which the 
plotting of the curve of age growth will become a simple matter. The 
significance of this will be sensed immediately by those who have 
had work in this field. Then, too, the question of a common factor 
in intelligence is necessarily implied in this study as well as other 
queries which the writer makes explicit. 

There is a brief historical survey of the literature relative to each 
of the topics into which the work is divided. While this historical 
setting reveals no unanimity of opinion, it does enable the reader to: 
get properly orientated for what is to follow. Here emphasis is justly 
laid on the necessity of knowing the conditions and of having them 
the same before a correlation is attempted. Also the effect of homo- 
geneity and of heterogeneity within the group, on the coefficient of 
correlation, is made clear. 

This is followed by a section on the administration of the tests 
used. The tests are described and the method of administering set 
forth. The arithmetical mean and the standard deviation is given for 
each test for each of the four years. The degree of correlation of 
the same test from year to year is indicated with explanations. 

In the part dealing specifically with results, Dr. Jones has used 
the correlation method of attack and has given a various combination 
of single test with single test; of single test with total-test-average; 
of total-test-average with total-test-average; and of tests with school 
year completed. In the last case only partial correlations have been 
given. 

The conclusions are a little disappointing but no more so than 
would naturally be expected. The problems to be solved are so funda- 
mental in their nature that much investigation will need be done 
on them. However, considerable light has been thrown on the 
subject and the way made clear for further work. The specific 
value of the tests used, during the years covered, as to ‘reliability’ 
and as to ‘stability’ is a point of special merit. The conclusion 
that development at this time is in content rather than in psychological 
process is interesting. Dr. Jones finds no evidence of a common 
memory factor, nor of a common intelligence quotient. Lastly, the 
results seem to show that after the elimination of the ‘ instructions 
factor’ experience tends to increase the correlation coefficient. 

The monograph is a carefully done piece of work along lines difficult 
of attainment and, in addition to the positive results presented, pre- 
pares the way for other investigations along similar lines. 


Cornell University. L. B. Hotrsincton. 


Wuuam A. Waite. The Principles of Mental Hygiene. The Mac- 
millan Company, New York, 1917, p. 323. 


This work is a discussion of such social problems as insanity, crime, 
feeblemindedness, etc., from the psychoanalytic standpoint, and not 
only treats of the various factors which unite to create the asocial 
classes, but also outlines prophylactic measures. While very concisely 
written, the volume is comprehensive in its scope, including many 
social phenomena popularly regarded as outside the field of mental 
hygiene, as alcoholism, vagrancy, divorce, the woman movement, and 
other minor aberrant forms of social life. “It is the task of mental 
hygiene,” says Dr. White, “to find less wasteful, more efficient means 
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for dealing with these problems, and, when found, to urge such meas- 
ures unceasingly upon those who make and administer our laws and 
direct the trends of public thought.” 

In the first chapters is a brief statement of some of the fundamental 
concepts of psychoanalysis, with the emphasis on the well-known 
Freudian flight from reality, which is later shown to be a leading 
motive in the types of conduct causing the social ills under considera- 
tion. “The instinct for the familiar—the safety motive” is the gen- 
eral term which is used to comprise such mental reactions as ambi- 
valence and projection of emotions, the hysterical conversion down- 
ward from the psychic to the physical level, and other defence mechan- 
isms. The genetic viewpoint is stressed throughout. “First of all, 
the great fact, it seems to me, which has always to be borne in mind, 
is the fact that our psyche bears the record of its hundreds of 
thousands of years’ development within itself as truly as does our 

y. . . . This is the historical past of the psyche, the uncon- 
scious, it has been called, because its content, while a part of the 
psyche, is still not in consciousness.” 

The application of these general considerations to the specific 
problems of mental hygiene is, in some instances, unique, and in 
almost every case there are at least one or two significant suggestions. 
The discussion of the social attitude toward the criminal and the 
plan for a reform of the penal system is worthy of mention in this 
respect. The criminal himself has long been disregarded by society, 
and only the crime has been considered. It is the emotional reaction 
to the act,—the hatred of the crime,—which, projected upon the crim- 
inal, has been the unconscious motivation behind our stringent penal 
laws, which punish, but do not prevent repetition of the deed. If 
we are to treat this whole problem in a way leading to social efficiency, 
we must recognize and control this projection mechanism, and study 
the criminal with a view to finding and remedying the causes of his 
conduct. ~ Instead of hard and fast rules for the treatment of each 
offense, the action toward the criminal must be modified in accordance 
with the findings of this searching analysis, which should determine 
whether he is a menace to society and must be imprisoned, or is a 
hopeful subject for more lenient reformatory efforts. Even those 
who are condemned, however, must enter a wholly different type of 
penal institution from that now in existence. The prison of the 
future will attempt to be constructive rather than destructive; to teach 
the prisoner a means of reaction at a higher social level instead of 
wreaking the vengeance of society upon him and creating in him an 
equal hatred which deepens his antisocial attitude. 2, 

In like manner, the treatment of the insane and of other pathological 


classes is outlined, with pertinent suggestions as to ways and means 


of prophylaxis. In one or two cases, the author departs radically 
from the generally accepted scientific attitude, and boldly states a 
wholly different point of view. In regard to the solution of the prob- 
lem of mental deficiency, for example, he vigorously opposes the 
Eugenist plan of sterilization on the ground that it is based on an 
exaggerated statement of the excessive procreation of the unfit, and 
is a method utterly unsuited to a humane and sympathetic social 
organization. That the latter consideration is the real reason for 
his opposition to a solution. which is increasingly advocated by science, 
is obvious from his own statement of his position: “I feel very much 
toward the question of sterilization as I do toward the proposition 
to chloroform all the insane and criminals. The dependents are the 
burdens which the efficient have to bear and become efficient in 
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bearing. The pain and suffering they cause have ‘forward ends’ 
which make for a better and more humane society. Chloroform 
might be a solution, but I, for one, would not like to live in a society 
which adopted it.” 

The book is an excellent review of the pathological phenomena 
of present civilization from the sociological and psychoanalytic stand- 
points, and should prove valuable in spreading a broad general knowl- 
edge of the whole mental hygiene movement. 

Puy.us BLANCHARD. 


Maximitian P. E. Groszmann. The Exceptional Child. Containing 
a Medical Symposium with Contributions from a Number of 
eg Specialists. Charles Scribner’s Sons, New York, 1917, 
Pp. ’ 

The author uses the word “exceptional” in its broadest sense. 
“The purpose of the book is to give a perspective of the entire situa- 
tion, and to suggest ways and means of coping with the problem in 
its various aspects.” The first part deals with the problem of the 
individual child, the second part discusses the problem of clinical 
research and diagnosis, and the third part takes up the problems of 
prevention, adjustment, and organization. The author estimates that 
of the twenty-four million children of school age in the United States 
about six million, or twenty-five per cent, are healthy normal, while 
about twice this number “suffer from easily removable difficulties, 
including physical ailments.” Of the remaining twenty-five per cent, 
eighteen per cent include “the exceptionally bright, the nervous, the 
difficult, the retarded child,” five per cent include “the blind, deaf, 
crippled, arrested, economically submerged, and primitive groups,” and 
the remaining two per cent or 480,000 include “the moral perverts 
and imbeciles, the feeble-minded, insane, etc.” The author has some- 
what modified the clessification of types of children which he had 
proposed some years ago, but he still retains the three main classes 
of normal, subnormal and abnormal children, and clearly defines or 
describes each type. He divides the exceptionally bright children 
into four groups; “the first group consists of children endowed with 
a good memory; the second group comprises those whose physical and 
mental growth is generally more rapid than that of an ordinary child 
without pathological precocity; the third group consists of children of 
one-sided development, i. e., having one faculty, or group of related 
faculties, developed out of proportion to the other faculties; the fourth 
group is composed of those children in which special or general excel- 
lency is associated with neuropathic and psychopathic tension.” It 
is not at all clear to -he reviewer why the first group should be set 
off from the third group. The author says: “the other three types 
involve intellectual faculties of an unusual character” (p. 107); evi 
dently memory, in the author’s view, is not an intellectual faculty 
In the chapter on the feeble-minded group (ch. 9, pp. 159-'84) the 
author criticizes adversely the diagnosis of such cases by the Binet 
Tests and offers several valuable precautions to be employed in 
determining the mental status of a child. Concerning the efforts of 
standardization our author says: “the science of child testing is so 
very young yet that it would be disastrous if we should allow our- 
selves to be guided by a more or less mechanical scale, in placing 
a certain mental manifestation in a certain definite place of quantita- 
tive value, and judging a child accordingly. We may have to revise 
our standards continually on the bases of further experience. It is 
for this reason that we must use any kind of tests simply as systema- 
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tized methods of approach and otherwise apply with fairness and 
oo pe sense our own standards of experience and judgment” (p. 
252). 
The second part presents a rather lengthy discussion of the tests 
employed in the study of exceptional children with a strong emphasis 
upon the author’s own methods of clinical treatment. Here the point 
of view of the surveyor has rather been lost sight of and frequently 
the lay reader is overwhelmed by the mass of technical details. On 
the whole the author’s views are very sane and his criticisms of 
the Binet tests are made to the point. In the third main part, how- 
ever, the author returns to his earlier perspective viewpoint and 
discusses such topics as legal provisions for various types of excep- 
tional children, eugenic considerations, home life and home education, 
school problems, medical inspection, ungraded and special classes, insti- 
tutional care, the sanatorium school, and the training of special 
teachers. 

Appendix I is a discussion of “ The City and her Boys” by Albert 
B. Hines of New York City. Appendix II is called “A Medical Sym- 
posium,” occupying pages 562 to 706, and consists of twenty-five 
contributions of varying —_— by men like E. H. Arnold of New - 
Haven, C. Ward Crampton, New York, Abraham Jacobs, New York, 
Howard A. Knox of Ellis Island, E. E. Southard, Boston, Ira S. Wile, 
New York, Tom A. Williams, Washington, D. C., Thomas D. Wood, 
New York, and others. In Appendix III are detailed first and second 
year data of P. E. G., and Appendix IV gives Specimens of Reports 
on Children Examined. A bibliography of nearly thirty pages con- 
cludes the work. 

The author’s style is lucid and non-technical. An especially attrac- 
tive feature is the use of cases as illustrative material, while the 
sixty-three pictorial illustrations add further value to the text. The 

k may be recommended to all who desire an authoritative and com- 
prehensive view of the numerous problems arising in connection with 
the exceptional child. L. R. G. 


The following publications have been received :' 


Cuartes Husparp Jupp. Introduction to the Scientific Study of Edu- 
cation. Ginn and Company, Boston, 1918. 


J. E. W. Wauun. The By ont eoyenns ag Clinic and Special Schools. 
Excerpt from Annual Report on St. Louis Public Schools, 1916-17, 
PP. 159-192. 


Carry On, A Magazine on the Reconstruction of Disabled Soldiers and 

ailors. Edited by the Office of the Surgeon General, U. S. 

Army. Published by the American Red Cross, 311 Fourth Avenue, 
New York City, vol. 1, No. 1, June 1918, pp. 1-32. 


The Ohio State Institution Journal. Edited by Frank B. O’Bleness. 
Published by the Ohio Board of Administration, Columbus, vol. 
1, No. 1, June 1918, pp. 1-84. 


The Porto Rico School Review. San Juan, Porto Rico, vol. 2, No. 6, 
June 1918. 


Report of the Commission on Military Training and Instruction in 
High Schools to the New Jersey Legislature, Session 1917. Re- 
— by the American Union Against Militarism, Washington, 

. CC. May 10918, pp. 1-15. 





1 Mention here does not preclude further comment. 














NOTES 


The Ohio Bureau of Juvenile Research, the first state bureau of 
its kind in the United States, has recently been established on a 
ermanent basis by the Board of Administration. The position of 
Director of the Bureau has been accepted by Dr. Henry H. Goddard, 
formerly Director of the Department of Research at the Vineland 
Training School for Feeble-minded. He will be assisted by Dr. 
Florence Mateer and Miss Lucile A. Boylan. The Bureau will also 
employ several physicians, psycho-clinicians, teachers, field-workers, 
and caretakers, and will closely co-operate with the Department of 
Psychology at Ohio State University, with the Juvenile Court, and 
with the Ohio Institution for Feeble-minded. The Bureau was au- 
thorized by the State Legislature in 1913 and began its work July 
Ist, 1914, under the Directorship of Dr. Thomas H. Haynes; but 
until last year no provision had been made for housing it. Last year 
the sum of $100,000 was appropriated for buildings which are at 
present near completion. The functions of the Bureau are two: (1) 
to study, diagnose, and recommend treatment or proper institution for 
such cases as are sent in by the juvenile courts of Ohio, and (2) to 
study the causes of dependency and delinquency. The methods to 
be employed will be largely determined by the material to be studied, 
and will include besides the usual mental and physical examinations 
such more extensive and elaborate methods as X-ray examinations, 
physiological studies of digestion, secretion, excretion, and of the 
endocrine system and whatever else may be suspected of contributing 
to the causes of delinquency. 


The Ohio Board of Administration, to which is entrusted the 
centralized management of all state institutions devoted to the care of 
the dependent wards of the state, began in June the publication of 
The Ohio State Institution Journal, under the editorship of Frank 
B. O’Bleness, Executive Clerk. This Journal is devoted “to the 
exposition of the work of the Ohio Board of Administration and the 
institutions under its control, in their efforts for the care and im- 
provement of the dependent, defective and delinquent classes: to the 
publication of the results of researches into conditions responsible 
for these classes, and the best methods of treatment and prevention: 
and to the promotion of a complete understanding between the public 
and the above named agencies in order that both may work in har- 
mony for the welfare of all.” The first issue contains a most instruc- 
tive account of several generations of the “ Hickory Family” and its 
branches, by Miss Mina A. Sessions. This family takes pre-eminence 
among the defective families of a certain county surveyed “ because 
of the fecundity of its members, the anti-social nature of their habits 
and mode of living, their utter dependency and the large amount of 
inbreeding which promises to perpetuate the defective traits.” 


The Office of the Surgeon-General, U. S. Army, has recently begun 
to edit and issue a new periodical, entitled Carry On, A Magazine on 
the Reconstrudtion of Disabled Soldiers and Sailors, which is pub- 
lished by the American Red Cross, 311 Fourth Avenue, New York 
City. The first number of volume one appeared in June and contains 
32 pages. The Editorial Board consists of Colonel Frank Billings, 
M. C,, N. A., Chairman; Lt.-Col. Casey Wood, M. C., N. A., Editor- 
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in-Chief; Captain Arthur H. Samuels, S. C., N. A., Assistant Editor; 
John O’Hara Cosgrave; Herbert Kaufman ; Lt.-Col. Harry E. Mock, 
M. C., N. A.; Douglas C. McMurtrie; and Charles J. Rosebault. The 
Advisory Board consists of twenty-cig ght members, among whom we 
find the names of Major-General William C. hg Honorable Wil- 
liam Howard Taft, Samuel Gompers, President Harry Pratt Judson, 
Major William James Mayo, Rochester, Minn., Mrs. Mary Roberts 
Rinehart, Dr. Anna Howard Shaw, and Lt. -Col. William H. Welch, 
M. C., N. A. The first issue contains among others short articles by 
Douglas C. McMurtrie on “The High Road to Self-Support;” by 
Ser; eant W. H. Zimmerman, A. E. F., on “Our Pn 3 Blinded 
Soldier ;” by Captain Arthur H. Samuels, S. C., N. A., on “ Recon- 
structing the Public;” and an unsigned article entitled “ The Enemy 
was Ready, How Germany Made Preparations for her Wounded.” 
The magazine is well illustrated with photographs of various phases 
of the work on reconstruction. 


The Staff of the Division of Physical Reconstruction in the office 
of the Surgeon-General, U. S. Army, contains, according to Carry On, 
among its members Dr. James E. ‘ussell, Dean of Teachers College, 
Columbia University, Director of Educational Section, and Major 
M. E. Haggerty, S. C., N. A., Professor of Psychology, Indiana 
=o SSE 

The following is a partial list of members of the American Psycho- 
logical Association who are engaged in national service of various 
kinds, including positions in the line, in the Sanitary Corps, in the 
Signal Corps, in the Aviation Service, in the Medical Reserve Corps, 
in the Y. M. C. A. work, as well as in civilian capacity. A complete 
list would probably show a 25 per cent enrollment in national service. 

Abbott, E. Stanley, Major, M. R. C. 

Angell, F meg R. 

Arps, ae x Captain, Ss. G 

Ash, Isaac Captain, S. C. 

Baird, John Wa lace 

Baldwin, Bird T., Major, S. C. 

Basset, G. C., Captain, S. oe 

Bentley, Madison, Captain, A 

Berry, Charles Scott, Captain, 

Bingham, H. C., Lieutenant, yo 

Bingham, W. V. 

Boring, Edwin G., Captain, S. C. 

Boswell, Foster P., Lieutenant, S. C. 

Bridges, J. W., S. C. 

Brigham, Carl C., Lieutenant, Tank Corps. 

Burtt, Harold E. 

Chapman, oe Crosby 

Chase, H 

Cobb, Percy W., Captain, M. R. C. 

Dallenbach, Karl M., Captain, S. C. 

Dearborn, George Van Ness, Lieutenant, M. R. C. 

Sse ogy Pll «. 


Dodge, 
Doll, E. A Li 5 RR 3, <. 
Dunlap, Knight, Captain, Ss. 
Edwards, A. S., Captain, S. C. 
Elliott, Richard M., Lieutenant, S. C. 
English, Horace B., Lieutenant, S. C. 
Ferguson, G. O., Lieutenant, S. C. 


S., Sig. B. C. 
Ss. 


Ss 
Cc. 




















NOTES 295 


Fernberger, Samuel W., Lieutenant, 304th Infantry. 

Foster, William S., Captain, S. C 

Franz, Shepherd 

Frost, Elliott Park, Lieutenant, S. C. 

Haggerty, Melvin E., Major, S. C 

Haines, Thomas H., S. C. 

Hall, G. Stanley 

Hayes, Joseph W., Captain, S. C. 

Henmon, V. A. C., Captain, A. S., Sig. R. C. 
~ Hunter, Walter S., Captain, S. C. 

Johnson, H. M. 

Jones, Edward S., Lieutenant, S. C. 

Kelley, Truman Lee 

Kellogg, Chester Elijah, Private, S. C. 

Kirby, T. J. 

Kitson, Harry Dexter, Lieutenant, Field Artillery. 

Metcalf, John T., Lieutenant, S. C. 

Moore, Henry T., Lieutenant, S. C. 

Morgan, John J. B., Lieutenant, S. C. 

Myers, Garry C., Private, S. C. 

Paterson, Donald G., Lieutenant, S. C. 

Pechstein, Louis A., Lieutenant, S. C. 

Pierce, Edgar A. B., Lieutenant, U. S. N. R. 

Pintner, Rudolph 

Poffenberger, A. T., Captain, S. C. 

Porter, James P., Captain, A. S., Sig. R. C. 

Prince, Morton 

Rich, Gilbert J., Private, S. C. 

Rowe, Eugene C., Captain, S. C. 

Ruml, Beardsley 

Russell, James E. 

Scott, Walter D. 

Seashore, C. E. 

Stratton, George M., Captain, A. S., Sig. R. C. 

Strong, Edward K., Jr. 

Sylvester, Reuel H., Lieutenant, S. C. 

Teachout, Robert B. 

Terman, Lewis M. 

Thorndike, E. L. 

Thurstone, L. L. 

Toll, Charles H., Lieutenant, S. C. 

Trabue, M. R., Captain, S. C. 

Watson, John B., Major, A. S., Sig. R. C. 

Waugh, Karl T., Major, S. C. 

Wells, F. Lyman, Captain, A. S., Sig. R. C. 

Wells, George R., Captain, S. C. 

Wembridge, Eleanor Rowland 

Wheeler, Raymond Holder, Lieutenant, S. C. 

Whipple, G. M. 

Witmer, Lightner 

Woodworth, R. S. 

Yerkes, Robert M., Major, S. C. 

Yoakum, Clarence S., Major, S. C. 


Will members kindly inform the Managing Editor of any errors 
or omissions? A list of all psychological workers in national service 
is planned to appear. in our next issue, and in order to make it as 
complete as possible information about psychologists engaged in 
national service is solicited. 
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COMMUNICATION 


The following communication has been received: 
GENTLEMEN : 


In the JourNAL or Appiiep Psycno ocy, Vol. II, 1918, No. I, p. 80, 
you print an article entitled “A Note on Mental —Peculiarities as 
Symptoms in Stuttering.” Will you be fair to the stammerers and 
print the other side of the case? 

You will undoubtedly accept Dr. E. W. Scripture’s testimony in 
regard to a fundamental fact as a basis for the discussion. He says, 
“If the question is asked of a patient in the fright stage, ‘Why do 
you stutter?’ he will answer, ‘ Because I am afraid that I will stutter.’” 

Accordingly, there are two elements of the disorder to be considered, 
namely the fear of stammering, and the convulsive effort. 

The fear originates in early childhood, in the period that precedes 
recollection and when the responsibility is entirely on the child’s 
parents or guardians. Scripture, Blanton, Fletcher and others have 
explained the origin of that fear. An accident or incident interferes 
with the child’s newly acquired and still unstable automatic speech, 
to overcome which interference the child makes a conscious speech 
effort, not realizing that its speech is now beyond the period of con- 
scious direction. This conscious effort, being misdirected, blocks the 
child’s normal speech and gives it an impression of inherent speech 
difficulty. Its companions laugh at its contortions and make it so 
uncomfortable that it acquires a fear of stammering, so it continues 
its efforts to avoid the stammering in order to escape the punishment. 

If the child is mentally deficient because it is unable to perceive 
in infancy that it is ‘impeding its speech, how much more deficient 
are those adult scientists who were unable to see that fact until 
Liebmann expressed it as an opinion, only, in 1914, and those scien- 
tists who are still unable to see it in 1918? 

That the convulsive effort is the impediment and that it is volun- 
tary, no one is excusable for not seeing. Who does not Know that 
when the stammerer desists from the effort his normal speech asserts 
itself? Why is it that an authority will spend hours trying to 
demonstrate a mythical impediment when he can prove the real 
impediment in ten seconds? Let anyone do what the stammerer does 
—press his lips tightly together, hold his breath, exhaust his breath, 
press his tongue against his upper teeth or his palate, and so on— 
and he must see that the misdirected effort blocks the normal speech. 
To reject that evident impediment in search of another is as in- 
admissible and unscientific as to reject mutual attraction in search 
of an unknown cause of gravitation. 

The child acquires this unfortunate habit of interfering with his 
speech. Society forces him to continue it. Parents make him talk 
on the principle that by talking he will overcome his fear; teachers 
make him stand up before a class and exhibit his infirmity, intensify- 
ing his affliction and infecting other pupils with it; employers expect 
the stammerer to conform to speech conventions injurious to him; 
even the agencies represented to benefit him—the stammering schools, 
clinics, and so on—teach him the breathing and articulatory exercises 
which Liebmann, Thorpe and innumerable subjects of those treatments 
have testified to result in intensified stammering outside the environ- 
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ment of the cure. This unjust and cruel treatment of the stammerer 
accounts for all his peculiarities, to wit: 


“ Brevity—short answers and short sentences.” Under conditions of 
special embarrassment he has had difficulty with certain sounds, so 
he fears those sounds and consequently stammers on them. In long 
speeches he would surely encounter some of them and consequently 
encounter difficulty, so he is brief. 

“ Sensitiveness.” He has been ridiculed and pointed out as a defec- 
tive. He sees people watching him to witness his next eontortion. 
He is shunned by people who find his affliction distressing or dangerous. 
He is misunderstood because he can not express himself and because 
he is judged by standards that are unjust to him. Who among his 
critics—rational critics—would not be sensitive under those con- 
ditions? 

“ Self-consciousness.” What makes self-consciousness but undue 
attention? Society is to blame for that: not the stammerer. The 
ticket-agent snaps at him, “Well, what do you want?” and the line 
of travelers stares at him. The people in the trolley car stare over 
their papers at him as he tries to ask for his transfer. Society makes 
him self-conscious and then calls him defective because he is what 
they have made him. 

“Undue speed in speech.” The beginning of an utterance is gen- 
erally the most difficult part for the stammerer; so, when he gets 
his normal speech going he tries to keep it going. He is merely 
endeavoring to avoid his impediment in order to avoid humiliation. 

“ Uninhibited speech.” Many authorities give inhibition as the stam- 
merer’s trouble. Comment may wait until agreement on the subject 
is reached. 

“Confusion of thoughts.” Anyone may be called on to speak before 
his thoughts are collected and in that circumstance the stammerer’s 
difficulty is enhanced because to the doubt of speech ability is added 
the doubt of what to say. Ordinarily, however, the stammerer’s 
thoughts are clear, before he encounters difficulty; for he has formu- 
lated them sometimes days, weeks or months ahead. But when he 
encounters difficulty he must think quickly in order to avoid it. If 
he can not think quickly enough he becomes confused, not as to what 
he wants to express but as to suitable words which he is able to utter. 
If he fails, his confusion is due to the humiliation, past or present, 
which society accords him. 

“ Early and quick onset of fatigue in mental processes.” Yes. The 
mental labor of circumventing the memories of thousands of humiliat- 
ing speech failures is prodigious, and therefore exhausting. That is 
one of the many reasons why school children should be excused from 
oral work. The mental effort which should be spent on the acquisi- 
tion of an education is spent in plans to circumvent the recitation- 
room torture. 

“Unsociability.” Society—not the stammerer. One of his great, 
unsatisfied longings is for understanding and sympathetic society. 

“Taciturnity.” Yes, especially in adult life. Forced to form and 
reform the anticipated expression of his ideas, he abandons much 
of the useless and unimportant. Realizing that the childhood care 
which would have saved him from a life of suffering has been kept 
from him by an impossible barrier of speculation, he does not feel 
affection for those persons or agencies which sacrifice the happiness 
of hundreds of thousands of human lives for a little notoriety or a 
few paltry fees. 
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“ Despondency.” Melancholia and suicide, too. 

“ Reticence.” Retention of what can not be uttered. 

“ Self-repression.” Without the “self.” Excepting the black slaves, 
and not excepting either the white slaves or the factory children, there 
is probably no other great class (1,000,000, in this country) so oppressed 
as the stammerers. The deaf, the lame, the blind, the sick, the im- 
poverished, the wage earner—every such class has agencies and influ- 
ences working for it. The stammerers have no organization, no publi- 
cation. The limited portion of the educational, scientific and medical 
press which considers the subject is devoted almost exclusively to 
disease theories of the disorder and to the mythical cure and is prac- 
tically closed to prevention and early correction. The private stam- 
mering-schools have been justly and repeatedly condemned, yet their 
methods are adopted in the public schools. Even the speech clinics 
pracdies the injurious treatments. The general press excludes the 

neficial information about stammering because it is not of general 
interest, but prints the harmful sensations because they are of general 
interest. The innumerable gerne: for the protection of the child are 
deaf to the __ of the little stammerer, and by their apathy main- 
tain the conditions which force that child into what Dr. Scripture calls 
a living death. - 

Will you do the stammerer the scant justice of printing his view 
that the charge of “ Mental Peculiarities”—and some other peculi- 
arities—belongs elsewhere. 

Sincerely, 
Ernest TOMPKINS. 





















































